API tools faq
paste
Advertisement
ticpu

rbd-nbd can not write to image

ticpu
Oct 3rd, 2017
164
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 462.04 KB | None | 0 0
raw download clone embed print report
  1. root@JeromeCauca|0|:~# rbd-nbd --cluster prod1 --debug_ms 10 -d map libvirt-pool/casrvloggerdead
  2. 2017-10-03 11:09:48.702771 7f6e92113e80 0 ceph version 12.2.1 (3e7492b9ada8bdc9a5cd0feafd42fbca27f9c38e) luminous (stable), process (unknown), pid 23163
  3. 2017-10-03 11:09:48.702800 7f6e92113e80 0 pidfile_write: ignore empty --pid-file
  4. 2017-10-03 11:09:48.704879 7f6e7f7fe700 2 Event(0x56221c94d380 nevent=5000 time_id=1).set_owner idx=0 owner=140112562218752
  5. 2017-10-03 11:09:48.704894 7f6e7f7fe700 10 stack operator() starting
  6. 2017-10-03 11:09:48.704944 7f6e7effd700 2 Event(0x56221c97a120 nevent=5000 time_id=1).set_owner idx=1 owner=140112553826048
  7. 2017-10-03 11:09:48.704955 7f6e7effd700 10 stack operator() starting
  8. 2017-10-03 11:09:48.704998 7f6e7e7fc700 2 Event(0x56221c9a6f50 nevent=5000 time_id=1).set_owner idx=2 owner=140112545433344
  9. 2017-10-03 11:09:48.705007 7f6e7e7fc700 10 stack operator() starting
  10. 2017-10-03 11:09:48.705186 7f6e92113e80 10 -- - ready -
  11. 2017-10-03 11:09:48.705187 7f6e92113e80 1 Processor -- start
  12. 2017-10-03 11:09:48.705235 7f6e92113e80 1 -- - start start
  13. 2017-10-03 11:09:48.705399 7f6e92113e80 10 -- - create_connect 10.10.4.36:6789/0, creating connection and registering
  14. 2017-10-03 11:09:48.705411 7f6e92113e80 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  15. 2017-10-03 11:09:48.705422 7f6e92113e80 10 -- - get_connection mon.0 10.10.4.36:6789/0 new 0x56221c9e3b10
  16. 2017-10-03 11:09:48.705427 7f6e92113e80 10 -- - create_connect 10.10.252.7:6789/0, creating connection and registering
  17. 2017-10-03 11:09:48.705434 7f6e92113e80 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  18. 2017-10-03 11:09:48.705441 7f6e92113e80 10 -- - get_connection mon.2 10.10.252.7:6789/0 new 0x56221c9e71a0
  19. 2017-10-03 11:09:48.705448 7f6e92113e80 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING pgs=0 cs=0 l=1).send_keepalive
  20. 2017-10-03 11:09:48.705453 7f6e92113e80 1 -- - --> 10.10.4.36:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x56221c9eb840 con 0
  21. 2017-10-03 11:09:48.705457 7f6e92113e80 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING pgs=0 cs=0 l=1).send_keepalive
  22. 2017-10-03 11:09:48.705461 7f6e92113e80 1 -- - --> 10.10.252.7:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x56221c9ecd00 con 0
  23. 2017-10-03 11:09:48.705522 7f6e7e7fc700 10 NetHandler reconnect reconnect: Operation already in progress
  24. 2017-10-03 11:09:48.705531 7f6e7effd700 10 NetHandler reconnect reconnect: Operation already in progress
  25. 2017-10-03 11:09:48.705532 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  26. 2017-10-03 11:09:48.705537 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  27. 2017-10-03 11:09:48.705544 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  28. 2017-10-03 11:09:48.705544 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  29. 2017-10-03 11:09:48.705546 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  30. 2017-10-03 11:09:48.705547 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  31. 2017-10-03 11:09:48.706130 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  32. 2017-10-03 11:09:48.706163 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  33. 2017-10-03 11:09:48.706170 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.7:6789/0
  34. 2017-10-03 11:09:48.706182 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  35. 2017-10-03 11:09:48.706186 7f6e7e7fc700 10 -- - >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  36. 2017-10-03 11:09:48.706232 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  37. 2017-10-03 11:09:48.706268 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  38. 2017-10-03 11:09:48.706274 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.4.36:6789/0
  39. 2017-10-03 11:09:48.706281 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  40. 2017-10-03 11:09:48.706283 7f6e7effd700 10 -- - >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  41. 2017-10-03 11:09:48.706732 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 learned_addr learned my addr 10.10.32.152:0/3071624645
  42. 2017-10-03 11:09:48.706747 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  43. 2017-10-03 11:09:48.706759 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  44. 2017-10-03 11:09:48.706763 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  45. 2017-10-03 11:09:48.706768 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  46. 2017-10-03 11:09:48.706769 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=2 cseq=0 proto=15
  47. 2017-10-03 11:09:48.706774 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=1 cseq=0 proto=15
  48. 2017-10-03 11:09:48.706780 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 33 remaining bytes 0
  49. 2017-10-03 11:09:48.706781 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 33 remaining bytes 0
  50. 2017-10-03 11:09:48.706786 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  51. 2017-10-03 11:09:48.706789 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  52. 2017-10-03 11:09:48.706789 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  53. 2017-10-03 11:09:48.706794 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  54. 2017-10-03 11:09:48.707079 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  55. 2017-10-03 11:09:48.707079 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  56. 2017-10-03 11:09:48.707089 7f6e7e7fc700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  57. 2017-10-03 11:09:48.707091 7f6e7effd700 2 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  58. 2017-10-03 11:09:48.707094 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  59. 2017-10-03 11:09:48.707095 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  60. 2017-10-03 11:09:48.707105 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  61. 2017-10-03 11:09:48.707108 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  62. 2017-10-03 11:09:48.707109 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  63. 2017-10-03 11:09:48.707113 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  64. 2017-10-03 11:09:48.707112 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  65. 2017-10-03 11:09:48.707124 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  66. 2017-10-03 11:09:48.707138 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).handle_write
  67. 2017-10-03 11:09:48.707142 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1)._append_keepalive_or_ack
  68. 2017-10-03 11:09:48.707147 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  69. 2017-10-03 11:09:48.707155 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._append_keepalive_or_ack
  70. 2017-10-03 11:09:48.707168 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1)._try_send sent bytes 148 remaining bytes 0
  71. 2017-10-03 11:09:48.707174 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).write_message sending 0x56221c9ecd00 done.
  72. 2017-10-03 11:09:48.707182 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).handle_write
  73. 2017-10-03 11:09:48.707187 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 148 remaining bytes 0
  74. 2017-10-03 11:09:48.707193 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x56221c9eb840 done.
  75. 2017-10-03 11:09:48.707200 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  76. 2017-10-03 11:09:48.707733 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1).process aborted = 0
  77. 2017-10-03 11:09:48.707733 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  78. 2017-10-03 11:09:48.707745 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1).process no session security set
  79. 2017-10-03 11:09:48.707748 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  80. 2017-10-03 11:09:48.707748 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1). rx mon.2 seq 1 0x7f6e68003be0 mon_map magic: 0 v1
  81. 2017-10-03 11:09:48.707753 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 1 0x7f6e74003c90 mon_map magic: 0 v1
  82. 2017-10-03 11:09:48.707774 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  83. 2017-10-03 11:09:48.707783 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  84. 2017-10-03 11:09:48.707787 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 2 0x7f6e74004280 auth_reply(proto 2 0 (0) Success) v1
  85. 2017-10-03 11:09:48.707813 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.2 10.10.252.7:6789/0 1 ==== mon_map magic: 0 v1 ==== 364+0+0 (2180324758 0 0) 0x7f6e68003be0 con 0x56221c9e71a0
  86. 2017-10-03 11:09:48.707818 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1).process aborted = 0
  87. 2017-10-03 11:09:48.707831 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1).process no session security set
  88. 2017-10-03 11:09:48.707834 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1). rx mon.2 seq 2 0x7f6e68004260 auth_reply(proto 2 0 (0) Success) v1
  89. 2017-10-03 11:09:48.707857 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 364 to dispatch throttler 794/104857600
  90. 2017-10-03 11:09:48.707862 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 1 ==== mon_map magic: 0 v1 ==== 364+0+0 (2180324758 0 0) 0x7f6e74003c90 con 0x56221c9e3b10
  91. 2017-10-03 11:09:48.707883 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 364 to dispatch throttler 430/104857600
  92. 2017-10-03 11:09:48.707886 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.2 10.10.252.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1391682865 0 0) 0x7f6e68004260 con 0x56221c9e71a0
  93. 2017-10-03 11:09:48.707963 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6e64001f60 con 0
  94. 2017-10-03 11:09:48.707973 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 33 to dispatch throttler 66/104857600
  95. 2017-10-03 11:09:48.707979 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).handle_write
  96. 2017-10-03 11:09:48.707979 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2354690026 0 0) 0x7f6e74004280 con 0x56221c9e3b10
  97. 2017-10-03 11:09:48.708010 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1)._try_send sent bytes 137 remaining bytes 0
  98. 2017-10-03 11:09:48.708012 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6e64003830 con 0
  99. 2017-10-03 11:09:48.708018 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).write_message sending 0x7f6e64001f60 done.
  100. 2017-10-03 11:09:48.708023 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 33 to dispatch throttler 33/104857600
  101. 2017-10-03 11:09:48.708031 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  102. 2017-10-03 11:09:48.708067 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 137 remaining bytes 0
  103. 2017-10-03 11:09:48.708073 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x7f6e64003830 done.
  104. 2017-10-03 11:09:48.708680 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  105. 2017-10-03 11:09:48.708689 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  106. 2017-10-03 11:09:48.708691 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 3 0x7f6e74004a50 auth_reply(proto 2 0 (0) Success) v1
  107. 2017-10-03 11:09:48.708707 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2455966047 0 0) 0x7f6e74004a50 con 0x56221c9e3b10
  108. 2017-10-03 11:09:48.708765 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e64003ef0 con 0
  109. 2017-10-03 11:09:48.708776 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 206 to dispatch throttler 206/104857600
  110. 2017-10-03 11:09:48.708780 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  111. 2017-10-03 11:09:48.708807 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 270 remaining bytes 0
  112. 2017-10-03 11:09:48.708812 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x7f6e64003ef0 done.
  113. 2017-10-03 11:09:48.708933 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1).process aborted = 0
  114. 2017-10-03 11:09:48.708939 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1).process no session security set
  115. 2017-10-03 11:09:48.708941 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=166792 cs=1 l=1). rx mon.2 seq 3 0x7f6e68004950 auth_reply(proto 2 0 (0) Success) v1
  116. 2017-10-03 11:09:48.708951 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.2 10.10.252.7:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1613994412 0 0) 0x7f6e68004950 con 0x56221c9e71a0
  117. 2017-10-03 11:09:48.708984 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e640046d0 con 0
  118. 2017-10-03 11:09:48.708991 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 206 to dispatch throttler 206/104857600
  119. 2017-10-03 11:09:48.708996 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).handle_write
  120. 2017-10-03 11:09:48.709017 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1)._try_send sent bytes 270 remaining bytes 0
  121. 2017-10-03 11:09:48.709021 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).write_message sending 0x7f6e640046d0 done.
  122. 2017-10-03 11:09:48.709400 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  123. 2017-10-03 11:09:48.709406 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  124. 2017-10-03 11:09:48.709408 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 4 0x7f6e74005740 auth_reply(proto 2 0 (0) Success) v1
  125. 2017-10-03 11:09:48.709419 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1880693833 0 0) 0x7f6e74005740 con 0x56221c9e3b10
  126. 2017-10-03 11:09:48.709484 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).mark_down
  127. 2017-10-03 11:09:48.709489 7f6e7d7fa700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1)._stop
  128. 2017-10-03 11:09:48.709492 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6789/0 conn(0x56221c9e71a0 :-1 s=STATE_OPEN pgs=166792 cs=1 l=1).discard_out_queue started
  129. 2017-10-03 11:09:48.709535 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_subscribe({monmap=0+}) v2 -- 0x56221c9ee2f0 con 0
  130. 2017-10-03 11:09:48.709552 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 580 to dispatch throttler 580/104857600
  131. 2017-10-03 11:09:48.709550 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  132. 2017-10-03 11:09:48.709580 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 98 remaining bytes 0
  133. 2017-10-03 11:09:48.709585 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x56221c9ee2f0 done.
  134. 2017-10-03 11:09:48.709605 7f6e92113e80 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_subscribe({mgrmap=0+}) v2 -- 0x56221c9ee2f0 con 0
  135. 2017-10-03 11:09:48.709618 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  136. 2017-10-03 11:09:48.709636 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 98 remaining bytes 0
  137. 2017-10-03 11:09:48.709642 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x56221c9ee2f0 done.
  138. 2017-10-03 11:09:48.709685 7f6e92113e80 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_subscribe({osdmap=0}) v2 -- 0x56221c9ee2f0 con 0
  139. 2017-10-03 11:09:48.709741 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  140. 2017-10-03 11:09:48.709764 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 98 remaining bytes 0
  141. 2017-10-03 11:09:48.709769 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x56221c9ee2f0 done.
  142. 2017-10-03 11:09:48.710102 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  143. 2017-10-03 11:09:48.710111 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  144. 2017-10-03 11:09:48.710113 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 5 0x7f6e74006a00 mon_map magic: 0 v1
  145. 2017-10-03 11:09:48.710122 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  146. 2017-10-03 11:09:48.710128 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 5 ==== mon_map magic: 0 v1 ==== 364+0+0 (2180324758 0 0) 0x7f6e74006a00 con 0x56221c9e3b10
  147. 2017-10-03 11:09:48.710138 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  148. 2017-10-03 11:09:48.710143 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 6 0x7f6e74007610 mgrmap(e 201) v1
  149. 2017-10-03 11:09:48.710159 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 364 to dispatch throttler 617/104857600
  150. 2017-10-03 11:09:48.710163 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 6 ==== mgrmap(e 201) v1 ==== 253+0+0 (2296646385 0 0) 0x7f6e74007610 con 0x56221c9e3b10
  151. 2017-10-03 11:09:48.710174 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.4.36:6800/28287, creating connection and registering
  152. 2017-10-03 11:09:48.710184 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  153. 2017-10-03 11:09:48.710192 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 get_connection mgr.35061755 10.10.4.36:6800/28287 new 0x7f6e6400d050
  154. 2017-10-03 11:09:48.710195 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 253 to dispatch throttler 253/104857600
  155. 2017-10-03 11:09:48.710231 7f6e7e7fc700 10 NetHandler reconnect reconnect: Operation already in progress
  156. 2017-10-03 11:09:48.710236 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  157. 2017-10-03 11:09:48.710314 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  158. 2017-10-03 11:09:48.710325 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  159. 2017-10-03 11:09:48.710329 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 7 0x7f6e74007610 osd_map(158049..158049 src has 157392..158049) v3
  160. 2017-10-03 11:09:48.710341 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 7 ==== osd_map(158049..158049 src has 157392..158049) v3 ==== 9556+0+0 (167096150 0 0) 0x7f6e74007610 con 0x56221c9e3b10
  161. 2017-10-03 11:09:48.710446 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 9556 to dispatch throttler 9556/104857600
  162. 2017-10-03 11:09:48.710516 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  163. 2017-10-03 11:09:48.710534 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  164. 2017-10-03 11:09:48.710539 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.4.36:6800/28287
  165. 2017-10-03 11:09:48.710620 7f6e92113e80 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.9:6808/29179, creating connection and registering
  166. 2017-10-03 11:09:48.710631 7f6e92113e80 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  167. 2017-10-03 11:09:48.710642 7f6e92113e80 10 -- 10.10.32.152:0/3071624645 get_connection osd.5 10.10.252.9:6808/29179 new 0x56221c9ef7a0
  168. 2017-10-03 11:09:48.710653 7f6e92113e80 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:1 3.142 3:4285911d:::rbd_id.casrvloggerdead:head [stat] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x56221c9f40f0 con 0
  169. 2017-10-03 11:09:48.710674 7f6e7f7fe700 10 NetHandler reconnect reconnect: Operation already in progress
  170. 2017-10-03 11:09:48.710678 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  171. 2017-10-03 11:09:48.710691 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  172. 2017-10-03 11:09:48.710870 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  173. 2017-10-03 11:09:48.710876 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  174. 2017-10-03 11:09:48.710898 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  175. 2017-10-03 11:09:48.710904 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=3 cseq=0 proto=0
  176. 2017-10-03 11:09:48.710912 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  177. 2017-10-03 11:09:48.711000 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  178. 2017-10-03 11:09:48.711022 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  179. 2017-10-03 11:09:48.711027 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.9:6808/29179
  180. 2017-10-03 11:09:48.711034 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  181. 2017-10-03 11:09:48.711039 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  182. 2017-10-03 11:09:48.711213 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  183. 2017-10-03 11:09:48.711228 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  184. 2017-10-03 11:09:48.711232 7f6e7e7fc700 2 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  185. 2017-10-03 11:09:48.711234 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  186. 2017-10-03 11:09:48.711243 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  187. 2017-10-03 11:09:48.711246 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  188. 2017-10-03 11:09:48.711249 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6800/28287 conn(0x7f6e6400d050 :-1 s=STATE_OPEN pgs=229052 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  189. 2017-10-03 11:09:48.711550 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  190. 2017-10-03 11:09:48.711555 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  191. 2017-10-03 11:09:48.711574 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  192. 2017-10-03 11:09:48.711579 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=4 cseq=0 proto=24
  193. 2017-10-03 11:09:48.711589 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  194. 2017-10-03 11:09:48.711596 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  195. 2017-10-03 11:09:48.711599 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  196. 2017-10-03 11:09:48.712077 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  197. 2017-10-03 11:09:48.712099 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  198. 2017-10-03 11:09:48.712105 7f6e7f7fe700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  199. 2017-10-03 11:09:48.712109 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  200. 2017-10-03 11:09:48.712130 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  201. 2017-10-03 11:09:48.712134 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  202. 2017-10-03 11:09:48.712138 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  203. 2017-10-03 11:09:48.712151 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  204. 2017-10-03 11:09:48.712190 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 306 remaining bytes 0
  205. 2017-10-03 11:09:48.712196 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x56221c9f40f0 done.
  206. 2017-10-03 11:09:48.712202 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  207. 2017-10-03 11:09:48.712815 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  208. 2017-10-03 11:09:48.712833 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 1 0x7f6e70004de0 osd_op_reply(1 rbd_id.casrvloggerdead [stat] v0'0 uv10712240 ondisk = 0) v8
  209. 2017-10-03 11:09:48.712839 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 1 ==== osd_op_reply(1 rbd_id.casrvloggerdead [stat] v0'0 uv10712240 ondisk = 0) v8 ==== 166+0+16 (1558816259 0 1115661461) 0x7f6e70004de0 con 0x56221c9ef7a0
  210. 2017-10-03 11:09:48.712859 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 182 to dispatch throttler 182/104857600
  211. 2017-10-03 11:09:48.712891 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:2 3.142 3:4285911d:::rbd_id.casrvloggerdead:head [call rbd.get_id] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60002150 con 0
  212. 2017-10-03 11:09:48.712928 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  213. 2017-10-03 11:09:48.712961 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 315 remaining bytes 0
  214. 2017-10-03 11:09:48.712966 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e60002150 done.
  215. 2017-10-03 11:09:48.713683 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  216. 2017-10-03 11:09:48.713699 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 2 0x7f6e700057b0 osd_op_reply(2 rbd_id.casrvloggerdead [call] v0'0 uv10712240 ondisk = 0) v8
  217. 2017-10-03 11:09:48.713705 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 2 ==== osd_op_reply(2 rbd_id.casrvloggerdead [call] v0'0 uv10712240 ondisk = 0) v8 ==== 166+0+18 (797155808 0 970324573) 0x7f6e700057b0 con 0x56221c9ef7a0
  218. 2017-10-03 11:09:48.713716 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  219. 2017-10-03 11:09:48.713744 7f6e6dffb700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.4:6804/25402, creating connection and registering
  220. 2017-10-03 11:09:48.713754 7f6e6dffb700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  221. 2017-10-03 11:09:48.713760 7f6e6dffb700 10 -- 10.10.32.152:0/3071624645 get_connection osd.8 10.10.252.4:6804/25402 new 0x7f6e600050d0
  222. 2017-10-03 11:09:48.713771 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:3 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_size,call rbd.get_object_prefix] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e600099d0 con 0
  223. 2017-10-03 11:09:48.713797 7f6e7effd700 10 NetHandler reconnect reconnect: Operation already in progress
  224. 2017-10-03 11:09:48.713804 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  225. 2017-10-03 11:09:48.713815 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  226. 2017-10-03 11:09:48.714131 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  227. 2017-10-03 11:09:48.714143 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  228. 2017-10-03 11:09:48.714147 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.4:6804/25402
  229. 2017-10-03 11:09:48.714152 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  230. 2017-10-03 11:09:48.714155 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  231. 2017-10-03 11:09:48.714614 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  232. 2017-10-03 11:09:48.714619 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  233. 2017-10-03 11:09:48.714630 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  234. 2017-10-03 11:09:48.714634 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=5 cseq=0 proto=24
  235. 2017-10-03 11:09:48.714638 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  236. 2017-10-03 11:09:48.714641 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  237. 2017-10-03 11:09:48.714643 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  238. 2017-10-03 11:09:48.715166 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  239. 2017-10-03 11:09:48.715183 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  240. 2017-10-03 11:09:48.715187 7f6e7effd700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  241. 2017-10-03 11:09:48.715189 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  242. 2017-10-03 11:09:48.715199 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  243. 2017-10-03 11:09:48.715202 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  244. 2017-10-03 11:09:48.715205 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  245. 2017-10-03 11:09:48.715217 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  246. 2017-10-03 11:09:48.715245 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 386 remaining bytes 0
  247. 2017-10-03 11:09:48.715250 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e600099d0 done.
  248. 2017-10-03 11:09:48.715254 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  249. 2017-10-03 11:09:48.716405 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  250. 2017-10-03 11:09:48.716424 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 1 0x7f6e7400d340 osd_op_reply(3 rbd_header.14481e238e1f29 [call,call] v0'0 uv22005940 ondisk = 0) v8
  251. 2017-10-03 11:09:48.716428 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 1 ==== osd_op_reply(3 rbd_header.14481e238e1f29 [call,call] v0'0 uv22005940 ondisk = 0) v8 ==== 211+0+36 (1964427544 0 3695660702) 0x7f6e7400d340 con 0x7f6e600050d0
  252. 2017-10-03 11:09:48.716438 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 247 to dispatch throttler 247/104857600
  253. 2017-10-03 11:09:48.716453 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:4 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_stripe_unit_count] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e600099d0 con 0
  254. 2017-10-03 11:09:48.716469 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  255. 2017-10-03 11:09:48.716499 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 333 remaining bytes 0
  256. 2017-10-03 11:09:48.716503 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e600099d0 done.
  257. 2017-10-03 11:09:48.717252 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  258. 2017-10-03 11:09:48.717275 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 2 0x7f6e7400df80 osd_op_reply(4 rbd_header.14481e238e1f29 [call] v0'0 uv0 ondisk = -8 ((8) Exec format error)) v8
  259. 2017-10-03 11:09:48.717289 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 2 ==== osd_op_reply(4 rbd_header.14481e238e1f29 [call] v0'0 uv0 ondisk = -8 ((8) Exec format error)) v8 ==== 169+0+0 (2079870737 0 0) 0x7f6e7400df80 con 0x7f6e600050d0
  260. 2017-10-03 11:09:48.717305 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  261. 2017-10-03 11:09:48.717329 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:5 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_create_timestamp] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60001b00 con 0
  262. 2017-10-03 11:09:48.717382 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  263. 2017-10-03 11:09:48.717422 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 332 remaining bytes 0
  264. 2017-10-03 11:09:48.717428 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60001b00 done.
  265. 2017-10-03 11:09:48.718171 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  266. 2017-10-03 11:09:48.718188 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 3 0x7f6e7400e970 osd_op_reply(5 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8
  267. 2017-10-03 11:09:48.718192 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 3 ==== osd_op_reply(5 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+8 (891288526 0 0) 0x7f6e7400e970 con 0x7f6e600050d0
  268. 2017-10-03 11:09:48.718202 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 177 to dispatch throttler 177/104857600
  269. 2017-10-03 11:09:48.718220 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:6 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_data_pool] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60001b00 con 0
  270. 2017-10-03 11:09:48.718253 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  271. 2017-10-03 11:09:48.718278 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 325 remaining bytes 0
  272. 2017-10-03 11:09:48.718281 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60001b00 done.
  273. 2017-10-03 11:09:48.719023 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  274. 2017-10-03 11:09:48.719046 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 4 0x7f6e7400f460 osd_op_reply(6 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8
  275. 2017-10-03 11:09:48.719051 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 4 ==== osd_op_reply(6 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+8 (176824660 0 3293575501) 0x7f6e7400f460 con 0x7f6e600050d0
  276. 2017-10-03 11:09:48.719064 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 177 to dispatch throttler 177/104857600
  277. 2017-10-03 11:09:48.719097 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:7 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.metadata_list] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60003f50 con 0
  278. 2017-10-03 11:09:48.719136 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  279. 2017-10-03 11:09:48.719170 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 342 remaining bytes 0
  280. 2017-10-03 11:09:48.719174 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60003f50 done.
  281. 2017-10-03 11:09:48.719899 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  282. 2017-10-03 11:09:48.719923 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 5 0x7f6e740100f0 osd_op_reply(7 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8
  283. 2017-10-03 11:09:48.719928 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 5 ==== osd_op_reply(7 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+4 (540593223 0 0) 0x7f6e740100f0 con 0x7f6e600050d0
  284. 2017-10-03 11:09:48.719941 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 173 to dispatch throttler 173/104857600
  285. 2017-10-03 11:09:48.724263 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:8 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch watch cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158049) v8 -- 0x7f6e60056490 con 0
  286. 2017-10-03 11:09:48.724305 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  287. 2017-10-03 11:09:48.724396 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  288. 2017-10-03 11:09:48.724413 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60056490 done.
  289. 2017-10-03 11:09:48.727041 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  290. 2017-10-03 11:09:48.727111 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 6 0x7f6e740108e0 osd_op_reply(8 rbd_header.14481e238e1f29 [watch watch cookie 140112034088384] v158049'22005966 uv22005940 ondisk = 0) v8
  291. 2017-10-03 11:09:48.727125 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 6 ==== osd_op_reply(8 rbd_header.14481e238e1f29 [watch watch cookie 140112034088384] v158049'22005966 uv22005940 ondisk = 0) v8 ==== 169+0+0 (2868990521 0 0) 0x7f6e740108e0 con 0x7f6e600050d0
  292. 2017-10-03 11:09:48.727153 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  293. 2017-10-03 11:09:48.727246 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:9 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_size,call rbd.get_features,call rbd.get_snapcontext,call rbd.get_parent,call lock.get_info] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60056490 con 0
  294. 2017-10-03 11:09:48.727282 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  295. 2017-10-03 11:09:48.727368 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 573 remaining bytes 0
  296. 2017-10-03 11:09:48.727375 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60056490 done.
  297. 2017-10-03 11:09:48.728857 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  298. 2017-10-03 11:09:48.728931 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 7 0x7f6e74011bb0 osd_op_reply(9 rbd_header.14481e238e1f29 [call,call,call,call,call] v0'0 uv22005940 ondisk = 0) v8
  299. 2017-10-03 11:09:48.728941 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 7 ==== osd_op_reply(9 rbd_header.14481e238e1f29 [call,call,call,call,call] v0'0 uv22005940 ondisk = 0) v8 ==== 337+0+204 (378799548 0 3012872244) 0x7f6e74011bb0 con 0x7f6e600050d0
  300. 2017-10-03 11:09:48.728972 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 541 to dispatch throttler 541/104857600
  301. 2017-10-03 11:09:48.729093 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:10 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_flags,call rbd.get_flags,call rbd.get_flags,call rbd.get_flags] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60056f50 con 0
  302. 2017-10-03 11:09:48.729170 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  303. 2017-10-03 11:09:48.729246 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 503 remaining bytes 0
  304. 2017-10-03 11:09:48.729252 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60056f50 done.
  305. 2017-10-03 11:09:48.730356 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  306. 2017-10-03 11:09:48.730408 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 8 0x7f6e74012650 osd_op_reply(10 rbd_header.14481e238e1f29 [call,call,call,call] v0'0 uv22005940 ondisk = 0) v8
  307. 2017-10-03 11:09:48.730415 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 8 ==== osd_op_reply(10 rbd_header.14481e238e1f29 [call,call,call,call] v0'0 uv22005940 ondisk = 0) v8 ==== 295+0+32 (517751906 0 0) 0x7f6e74012650 con 0x7f6e600050d0
  308. 2017-10-03 11:09:48.730450 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 327 to dispatch throttler 327/104857600
  309. 2017-10-03 11:09:48.730499 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:11 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.image_get_group] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60056ae0 con 0
  310. 2017-10-03 11:09:48.730567 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  311. 2017-10-03 11:09:48.730629 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 327 remaining bytes 0
  312. 2017-10-03 11:09:48.730634 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60056ae0 done.
  313. 2017-10-03 11:09:48.731409 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  314. 2017-10-03 11:09:48.731456 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 9 0x7f6e740129b0 osd_op_reply(11 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8
  315. 2017-10-03 11:09:48.731464 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 9 ==== osd_op_reply(11 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+18 (3116110415 0 3089390191) 0x7f6e740129b0 con 0x7f6e600050d0
  316. 2017-10-03 11:09:48.731487 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 187 to dispatch throttler 187/104857600
  317. 2017-10-03 11:09:48.731571 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:12 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status,call rbd.get_snapshot_name,call rbd.get_size,call rbd.get_parent,call rbd.get_protection_status] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60056ae0 con 0
  318. 2017-10-03 11:09:48.731641 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  319. 2017-10-03 11:09:48.731705 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 1027 remaining bytes 0
  320. 2017-10-03 11:09:48.731710 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60056ae0 done.
  321. 2017-10-03 11:09:48.733773 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  322. 2017-10-03 11:09:48.733815 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 10 0x7f6e74015380 osd_op_reply(12 rbd_header.14481e238e1f29 [call,call,call,call,call,call,call,call,call,call,call,call] v0'0 uv22005940 ondisk = 0) v8
  323. 2017-10-03 11:09:48.733822 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 10 ==== osd_op_reply(12 rbd_header.14481e238e1f29 [call,call,call,call,call,call,call,call,call,call,call,call] v0'0 uv22005940 ondisk = 0) v8 ==== 631+0+159 (1858877268 0 2710519864) 0x7f6e74015380 con 0x7f6e600050d0
  324. 2017-10-03 11:09:48.733846 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 790 to dispatch throttler 790/104857600
  325. 2017-10-03 11:09:48.733892 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:13 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_snapshot_timestamp,call rbd.get_snapshot_timestamp,call rbd.get_snapshot_timestamp] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e600797e0 con 0
  326. 2017-10-03 11:09:48.733953 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  327. 2017-10-03 11:09:48.734009 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 484 remaining bytes 0
  328. 2017-10-03 11:09:48.734014 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e600797e0 done.
  329. 2017-10-03 11:09:48.734968 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  330. 2017-10-03 11:09:48.734986 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 11 0x7f6e74013690 osd_op_reply(13 rbd_header.14481e238e1f29 [call,call,call] v0'0 uv22005940 ondisk = 0) v8
  331. 2017-10-03 11:09:48.734990 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 11 ==== osd_op_reply(13 rbd_header.14481e238e1f29 [call,call,call] v0'0 uv22005940 ondisk = 0) v8 ==== 253+0+24 (731463790 0 1858161219) 0x7f6e74013690 con 0x7f6e600050d0
  332. 2017-10-03 11:09:48.735000 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 277 to dispatch throttler 277/104857600
  333. 2017-10-03 11:09:48.735036 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:14 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call rbd.get_snapshot_namespace,call rbd.get_snapshot_namespace,call rbd.get_snapshot_namespace] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e6007e710 con 0
  334. 2017-10-03 11:09:48.735075 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  335. 2017-10-03 11:09:48.735103 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 484 remaining bytes 0
  336. 2017-10-03 11:09:48.735106 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e6007e710 done.
  337. 2017-10-03 11:09:48.736078 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  338. 2017-10-03 11:09:48.736090 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 12 0x7f6e74015380 osd_op_reply(14 rbd_header.14481e238e1f29 [call,call,call] v0'0 uv22005940 ondisk = 0) v8
  339. 2017-10-03 11:09:48.736093 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 12 ==== osd_op_reply(14 rbd_header.14481e238e1f29 [call,call,call] v0'0 uv22005940 ondisk = 0) v8 ==== 253+0+30 (908186660 0 3427260264) 0x7f6e74015380 con 0x7f6e600050d0
  340. 2017-10-03 11:09:48.736101 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 283 to dispatch throttler 283/104857600
  341. /dev/nbd0
  342. 2017-10-03 11:09:48.737346 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.1:6800/18889, creating connection and registering
  343. 2017-10-03 11:09:48.737361 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  344. 2017-10-03 11:09:48.737368 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 get_connection osd.1 10.10.252.1:6800/18889 new 0x7f6e5c002f50
  345. 2017-10-03 11:09:48.737375 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6800/18889 -- osd_op(unknown.0.0:15 3.11e 3:78ee0653:::rbd_data.14481e238e1f29.0000000000000000:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0079c0 con 0
  346. 2017-10-03 11:09:48.737445 7f6e7e7fc700 10 NetHandler reconnect reconnect: Operation already in progress
  347. 2017-10-03 11:09:48.737452 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  348. 2017-10-03 11:09:48.737458 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  349. 2017-10-03 11:09:48.737714 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  350. 2017-10-03 11:09:48.737733 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  351. 2017-10-03 11:09:48.737737 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.1:6800/18889
  352. 2017-10-03 11:09:48.737742 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  353. 2017-10-03 11:09:48.737745 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  354. 2017-10-03 11:09:48.738237 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  355. 2017-10-03 11:09:48.738245 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  356. 2017-10-03 11:09:48.738270 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  357. 2017-10-03 11:09:48.738273 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=6 cseq=0 proto=24
  358. 2017-10-03 11:09:48.738280 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  359. 2017-10-03 11:09:48.738284 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  360. 2017-10-03 11:09:48.738286 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  361. 2017-10-03 11:09:48.738838 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  362. 2017-10-03 11:09:48.738852 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  363. 2017-10-03 11:09:48.738855 7f6e7e7fc700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  364. 2017-10-03 11:09:48.738857 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  365. 2017-10-03 11:09:48.738867 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  366. 2017-10-03 11:09:48.738869 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  367. 2017-10-03 11:09:48.738871 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  368. 2017-10-03 11:09:48.738889 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).handle_write
  369. 2017-10-03 11:09:48.738913 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  370. 2017-10-03 11:09:48.738917 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).write_message sending 0x7f6e5c0079c0 done.
  371. 2017-10-03 11:09:48.738921 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).handle_write
  372. 2017-10-03 11:09:48.739826 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1).process aborted = 0
  373. 2017-10-03 11:09:48.739853 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1). rx osd.1 seq 1 0x7f6e6800b8f0 osd_op_reply(15 rbd_data.14481e238e1f29.0000000000000000 [read 0~4096] v0'0 uv15715197 ondisk = 0) v8
  374. 2017-10-03 11:09:48.739860 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.1 10.10.252.1:6800/18889 1 ==== osd_op_reply(15 rbd_data.14481e238e1f29.0000000000000000 [read 0~4096] v0'0 uv15715197 ondisk = 0) v8 ==== 184+0+4096 (1370772936 0 3432219861) 0x7f6e6800b8f0 con 0x7f6e5c002f50
  375. 2017-10-03 11:09:48.739877 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  376. 2017-10-03 11:09:48.740033 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.1:6804/26510, creating connection and registering
  377. 2017-10-03 11:09:48.740048 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  378. 2017-10-03 11:09:48.740056 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 get_connection osd.9 10.10.252.1:6804/26510 new 0x7f6e5c008a70
  379. 2017-10-03 11:09:48.740061 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:16 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 1044480~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c00d3f0 con 0
  380. 2017-10-03 11:09:48.740120 7f6e7f7fe700 10 NetHandler reconnect reconnect: Operation already in progress
  381. 2017-10-03 11:09:48.740126 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  382. 2017-10-03 11:09:48.740132 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  383. 2017-10-03 11:09:48.740376 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  384. 2017-10-03 11:09:48.740400 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  385. 2017-10-03 11:09:48.740406 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.1:6804/26510
  386. 2017-10-03 11:09:48.740414 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  387. 2017-10-03 11:09:48.740417 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  388. 2017-10-03 11:09:48.740828 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  389. 2017-10-03 11:09:48.740835 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  390. 2017-10-03 11:09:48.740868 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  391. 2017-10-03 11:09:48.740875 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=7 cseq=0 proto=24
  392. 2017-10-03 11:09:48.740885 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  393. 2017-10-03 11:09:48.740891 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  394. 2017-10-03 11:09:48.740894 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  395. 2017-10-03 11:09:48.741328 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  396. 2017-10-03 11:09:48.741350 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  397. 2017-10-03 11:09:48.741357 7f6e7f7fe700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  398. 2017-10-03 11:09:48.741360 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  399. 2017-10-03 11:09:48.741374 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  400. 2017-10-03 11:09:48.741380 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  401. 2017-10-03 11:09:48.741392 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  402. 2017-10-03 11:09:48.741406 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  403. 2017-10-03 11:09:48.741444 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  404. 2017-10-03 11:09:48.741458 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c00d3f0 done.
  405. 2017-10-03 11:09:48.741464 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  406. 2017-10-03 11:09:48.742487 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  407. 2017-10-03 11:09:48.742554 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 1 0x7f6e700095b0 osd_op_reply(16 rbd_data.14481e238e1f29.000000000000003d [read 1044480~4096] v0'0 uv25292674 ondisk = 0) v8
  408. 2017-10-03 11:09:48.742566 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 1 ==== osd_op_reply(16 rbd_data.14481e238e1f29.000000000000003d [read 1044480~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (644113122 0 496265333) 0x7f6e700095b0 con 0x7f6e5c008a70
  409. 2017-10-03 11:09:48.742595 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  410. 2017-10-03 11:09:52.424635 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:17 3.b2 3:4d4203cb:::rbd_data.14481e238e1f29.000000000000003c:head [read 4128768~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c00df60 con 0
  411. 2017-10-03 11:09:52.424766 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  412. 2017-10-03 11:09:52.424965 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  413. 2017-10-03 11:09:52.424993 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e5c00df60 done.
  414. 2017-10-03 11:09:52.426376 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  415. 2017-10-03 11:09:52.426456 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 13 0x7f6e74017010 osd_op_reply(17 rbd_data.14481e238e1f29.000000000000003c [read 4128768~4096] v0'0 uv15554805 ondisk = 0) v8
  416. 2017-10-03 11:09:52.426482 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 13 ==== osd_op_reply(17 rbd_data.14481e238e1f29.000000000000003c [read 4128768~4096] v0'0 uv15554805 ondisk = 0) v8 ==== 184+0+4096 (1145370732 0 0) 0x7f6e74017010 con 0x7f6e600050d0
  417. 2017-10-03 11:09:52.426528 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  418. 2017-10-03 11:09:52.427034 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:18 3.b2 3:4d4203cb:::rbd_data.14481e238e1f29.000000000000003c:head [read 4186112~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c00e530 con 0
  419. 2017-10-03 11:09:52.427148 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  420. 2017-10-03 11:09:52.427296 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  421. 2017-10-03 11:09:52.427314 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e5c00e530 done.
  422. 2017-10-03 11:09:52.428404 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  423. 2017-10-03 11:09:52.428471 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 14 0x7f6e74017890 osd_op_reply(18 rbd_data.14481e238e1f29.000000000000003c [read 4186112~4096] v0'0 uv15554805 ondisk = 0) v8
  424. 2017-10-03 11:09:52.428492 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 14 ==== osd_op_reply(18 rbd_data.14481e238e1f29.000000000000003c [read 4186112~4096] v0'0 uv15554805 ondisk = 0) v8 ==== 184+0+4096 (3649002278 0 0) 0x7f6e74017890 con 0x7f6e600050d0
  425. 2017-10-03 11:09:52.428529 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  426. 2017-10-03 11:09:52.428863 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6800/18889 -- osd_op(unknown.0.0:19 3.11e 3:78ee0653:::rbd_data.14481e238e1f29.0000000000000000:head [read 1048576~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c00df60 con 0
  427. 2017-10-03 11:09:52.428986 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).handle_write
  428. 2017-10-03 11:09:52.429130 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  429. 2017-10-03 11:09:52.429147 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).write_message sending 0x7f6e5c00df60 done.
  430. 2017-10-03 11:09:52.430226 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1).process aborted = 0
  431. 2017-10-03 11:09:52.430293 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1). rx osd.1 seq 2 0x7f6e6800d3d0 osd_op_reply(19 rbd_data.14481e238e1f29.0000000000000000 [read 1048576~4096] v0'0 uv15715197 ondisk = 0) v8
  432. 2017-10-03 11:09:52.430313 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.1 10.10.252.1:6800/18889 2 ==== osd_op_reply(19 rbd_data.14481e238e1f29.0000000000000000 [read 1048576~4096] v0'0 uv15715197 ondisk = 0) v8 ==== 184+0+4096 (379108842 0 3602229281) 0x7f6e6800d3d0 con 0x7f6e5c002f50
  433. 2017-10-03 11:09:52.430346 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  434. 2017-10-03 11:09:52.430609 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6800/18889 -- osd_op(unknown.0.0:20 3.11e 3:78ee0653:::rbd_data.14481e238e1f29.0000000000000000:head [read 1052672~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c00df60 con 0
  435. 2017-10-03 11:09:52.430686 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).handle_write
  436. 2017-10-03 11:09:52.430819 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  437. 2017-10-03 11:09:52.430836 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).write_message sending 0x7f6e5c00df60 done.
  438. 2017-10-03 11:09:52.431893 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1).process aborted = 0
  439. 2017-10-03 11:09:52.431961 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1). rx osd.1 seq 3 0x7f6e6800f010 osd_op_reply(20 rbd_data.14481e238e1f29.0000000000000000 [read 1052672~4096] v0'0 uv15715197 ondisk = 0) v8
  440. 2017-10-03 11:09:52.431981 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.1 10.10.252.1:6800/18889 3 ==== osd_op_reply(20 rbd_data.14481e238e1f29.0000000000000000 [read 1052672~4096] v0'0 uv15715197 ondisk = 0) v8 ==== 184+0+4096 (3612962603 0 3708482419) 0x7f6e6800f010 con 0x7f6e5c002f50
  441. 2017-10-03 11:09:52.432017 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  442. 2017-10-03 11:09:52.438976 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.7:6800/15314, creating connection and registering
  443. 2017-10-03 11:09:52.439041 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  444. 2017-10-03 11:09:52.439078 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 get_connection osd.15 10.10.252.7:6800/15314 new 0x7f6e5c00f790
  445. 2017-10-03 11:09:52.439115 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:21 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 3080192~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c013f50 con 0
  446. 2017-10-03 11:09:52.439237 7f6e7effd700 10 NetHandler reconnect reconnect: Operation already in progress
  447. 2017-10-03 11:09:52.439258 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  448. 2017-10-03 11:09:52.439288 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  449. 2017-10-03 11:09:52.439641 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  450. 2017-10-03 11:09:52.439716 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  451. 2017-10-03 11:09:52.439736 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.7:6800/15314
  452. 2017-10-03 11:09:52.439770 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  453. 2017-10-03 11:09:52.439786 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  454. 2017-10-03 11:09:52.440074 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  455. 2017-10-03 11:09:52.440095 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  456. 2017-10-03 11:09:52.440167 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  457. 2017-10-03 11:09:52.440189 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=8 cseq=0 proto=24
  458. 2017-10-03 11:09:52.440222 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  459. 2017-10-03 11:09:52.440242 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  460. 2017-10-03 11:09:52.440256 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  461. 2017-10-03 11:09:52.440693 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  462. 2017-10-03 11:09:52.440749 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  463. 2017-10-03 11:09:52.440769 7f6e7effd700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  464. 2017-10-03 11:09:52.440779 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  465. 2017-10-03 11:09:52.440824 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  466. 2017-10-03 11:09:52.440835 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  467. 2017-10-03 11:09:52.440845 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  468. 2017-10-03 11:09:52.440899 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  469. 2017-10-03 11:09:52.441000 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  470. 2017-10-03 11:09:52.441020 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c013f50 done.
  471. 2017-10-03 11:09:52.441039 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  472. 2017-10-03 11:09:52.441703 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  473. 2017-10-03 11:09:52.441763 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 1 0x7f6e7401c7f0 osd_op_reply(21 rbd_data.14481e238e1f29.00000000000007ff [read 3080192~0] v0'0 uv22140457 ondisk = 0) v8
  474. 2017-10-03 11:09:52.441785 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 1 ==== osd_op_reply(21 rbd_data.14481e238e1f29.00000000000007ff [read 3080192~0] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+0 (3726017179 0 0) 0x7f6e7401c7f0 con 0x7f6e5c00f790
  475. 2017-10-03 11:09:52.441833 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  476. 2017-10-03 11:09:52.442265 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:22 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 3137536~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c014750 con 0
  477. 2017-10-03 11:09:52.442334 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  478. 2017-10-03 11:09:52.442468 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  479. 2017-10-03 11:09:52.442485 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c014750 done.
  480. 2017-10-03 11:09:52.443161 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  481. 2017-10-03 11:09:52.443223 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 2 0x7f6e7401d030 osd_op_reply(22 rbd_data.14481e238e1f29.00000000000007ff [read 3137536~0] v0'0 uv22140457 ondisk = 0) v8
  482. 2017-10-03 11:09:52.443246 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 2 ==== osd_op_reply(22 rbd_data.14481e238e1f29.00000000000007ff [read 3137536~0] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+0 (1127031249 0 0) 0x7f6e7401d030 con 0x7f6e5c00f790
  483. 2017-10-03 11:09:52.443284 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  484. 2017-10-03 11:09:52.443566 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:23 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 1048576~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c014750 con 0
  485. 2017-10-03 11:09:52.443630 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  486. 2017-10-03 11:09:52.443725 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  487. 2017-10-03 11:09:52.443739 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c014750 done.
  488. 2017-10-03 11:09:52.444698 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  489. 2017-10-03 11:09:52.444744 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 2 0x7f6e7000b530 osd_op_reply(23 rbd_data.14481e238e1f29.000000000000003d [read 1048576~4096] v0'0 uv25292674 ondisk = 0) v8
  490. 2017-10-03 11:09:52.444762 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 2 ==== osd_op_reply(23 rbd_data.14481e238e1f29.000000000000003d [read 1048576~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (3762835150 0 3803449428) 0x7f6e7000b530 con 0x7f6e5c008a70
  491. 2017-10-03 11:09:52.444795 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  492. 2017-10-03 11:09:52.445109 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:24 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 1052672~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c014750 con 0
  493. 2017-10-03 11:09:52.445182 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  494. 2017-10-03 11:09:52.445301 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  495. 2017-10-03 11:09:52.445312 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c014750 done.
  496. 2017-10-03 11:09:52.446287 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  497. 2017-10-03 11:09:52.446350 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 3 0x7f6e7000d1e0 osd_op_reply(24 rbd_data.14481e238e1f29.000000000000003d [read 1052672~4096] v0'0 uv25292674 ondisk = 0) v8
  498. 2017-10-03 11:09:52.446365 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 3 ==== osd_op_reply(24 rbd_data.14481e238e1f29.000000000000003d [read 1052672~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (562666511 0 40299328) 0x7f6e7000d1e0 con 0x7f6e5c008a70
  499. 2017-10-03 11:09:52.446402 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  500. 2017-10-03 11:09:52.447230 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:25 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c014750 con 0
  501. 2017-10-03 11:09:52.447305 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  502. 2017-10-03 11:09:52.447434 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  503. 2017-10-03 11:09:52.447444 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c014750 done.
  504. 2017-10-03 11:09:52.448415 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  505. 2017-10-03 11:09:52.448465 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 4 0x7f6e7000dc00 osd_op_reply(25 rbd_data.14481e238e1f29.000000000000003d [read 1114112~4096] v0'0 uv25292674 ondisk = 0) v8
  506. 2017-10-03 11:09:52.448480 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 4 ==== osd_op_reply(25 rbd_data.14481e238e1f29.000000000000003d [read 1114112~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (3297185426 0 3913717884) 0x7f6e7000dc00 con 0x7f6e5c008a70
  507. 2017-10-03 11:09:52.448527 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  508. 2017-10-03 11:09:53.709839 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:26 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158049) v8 -- 0x7f6e50000e40 con 0
  509. 2017-10-03 11:09:53.709930 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_subscribe({osdmap=158050}) v2 -- 0x7f6e500017a0 con 0
  510. 2017-10-03 11:09:53.709938 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50001f10 con 0
  511. 2017-10-03 11:09:53.709938 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  512. 2017-10-03 11:09:53.710065 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  513. 2017-10-03 11:09:53.710095 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50001f10 done.
  514. 2017-10-03 11:09:53.710207 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  515. 2017-10-03 11:09:53.710237 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  516. 2017-10-03 11:09:53.710241 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  517. 2017-10-03 11:09:53.710295 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 98 remaining bytes 0
  518. 2017-10-03 11:09:53.710298 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x7f6e500017a0 done.
  519. 2017-10-03 11:09:53.710306 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  520. 2017-10-03 11:09:53.711276 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  521. 2017-10-03 11:09:53.711321 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 15 0x7f6e7401e460 osd_op_reply(26 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005940 ondisk = 0) v8
  522. 2017-10-03 11:09:53.711346 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 15 ==== osd_op_reply(26 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+0 (2146651683 0 0) 0x7f6e7401e460 con 0x7f6e600050d0
  523. 2017-10-03 11:09:53.711379 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  524. 2017-10-03 11:09:58.488212 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.9:6800/28044, creating connection and registering
  525. 2017-10-03 11:09:58.488257 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  526. 2017-10-03 11:09:58.488275 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 get_connection osd.0 10.10.252.9:6800/28044 new 0x7f6e5c015e80
  527. 2017-10-03 11:09:58.488308 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:27 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2031616~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01a520 con 0
  528. 2017-10-03 11:09:58.488376 7f6e7e7fc700 10 NetHandler reconnect reconnect: Operation already in progress
  529. 2017-10-03 11:09:58.488387 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  530. 2017-10-03 11:09:58.488403 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  531. 2017-10-03 11:09:58.488848 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  532. 2017-10-03 11:09:58.488897 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  533. 2017-10-03 11:09:58.488913 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.9:6800/28044
  534. 2017-10-03 11:09:58.488947 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  535. 2017-10-03 11:09:58.488952 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  536. 2017-10-03 11:09:58.489032 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:28 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 2031616~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01bb00 con 0
  537. 2017-10-03 11:09:58.489062 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  538. 2017-10-03 11:09:58.489131 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  539. 2017-10-03 11:09:58.489137 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01bb00 done.
  540. 2017-10-03 11:09:58.489414 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  541. 2017-10-03 11:09:58.489423 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  542. 2017-10-03 11:09:58.489445 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  543. 2017-10-03 11:09:58.489454 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=9 cseq=0 proto=24
  544. 2017-10-03 11:09:58.489466 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  545. 2017-10-03 11:09:58.489473 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  546. 2017-10-03 11:09:58.489476 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  547. 2017-10-03 11:09:58.489970 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  548. 2017-10-03 11:09:58.490005 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  549. 2017-10-03 11:09:58.490013 7f6e7e7fc700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  550. 2017-10-03 11:09:58.490016 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  551. 2017-10-03 11:09:58.490037 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  552. 2017-10-03 11:09:58.490044 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  553. 2017-10-03 11:09:58.490049 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  554. 2017-10-03 11:09:58.490071 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  555. 2017-10-03 11:09:58.490112 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  556. 2017-10-03 11:09:58.490122 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01a520 done.
  557. 2017-10-03 11:09:58.490131 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  558. 2017-10-03 11:09:58.490193 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  559. 2017-10-03 11:09:58.490234 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 3 0x7f6e7401f480 osd_op_reply(28 rbd_data.14481e238e1f29.00000000000007ff [read 2031616~4096] v0'0 uv22140457 ondisk = 0) v8
  560. 2017-10-03 11:09:58.490249 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 3 ==== osd_op_reply(28 rbd_data.14481e238e1f29.00000000000007ff [read 2031616~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (497775010 0 3412829417) 0x7f6e7401f480 con 0x7f6e5c00f790
  561. 2017-10-03 11:09:58.490277 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  562. 2017-10-03 11:09:58.490466 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:29 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 2088960~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01bb00 con 0
  563. 2017-10-03 11:09:58.490500 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  564. 2017-10-03 11:09:58.490571 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  565. 2017-10-03 11:09:58.490583 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01bb00 done.
  566. 2017-10-03 11:09:58.490927 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  567. 2017-10-03 11:09:58.490965 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 1 0x7f6e68014a40 osd_op_reply(27 rbd_data.14481e238e1f29.00000000000007a1 [read 2031616~4096] v0'0 uv24009468 ondisk = 0) v8
  568. 2017-10-03 11:09:58.490976 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 1 ==== osd_op_reply(27 rbd_data.14481e238e1f29.00000000000007a1 [read 2031616~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (2730820856 0 1129039083) 0x7f6e68014a40 con 0x7f6e5c015e80
  569. 2017-10-03 11:09:58.490997 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  570. 2017-10-03 11:09:58.491156 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:30 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2088960~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01bb00 con 0
  571. 2017-10-03 11:09:58.491196 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  572. 2017-10-03 11:09:58.491265 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  573. 2017-10-03 11:09:58.491274 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01bb00 done.
  574. 2017-10-03 11:09:58.491338 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  575. 2017-10-03 11:09:58.491373 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 4 0x7f6e74021010 osd_op_reply(29 rbd_data.14481e238e1f29.00000000000007ff [read 2088960~4096] v0'0 uv22140457 ondisk = 0) v8
  576. 2017-10-03 11:09:58.491383 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 4 ==== osd_op_reply(29 rbd_data.14481e238e1f29.00000000000007ff [read 2088960~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (2156974824 0 3042357989) 0x7f6e74021010 con 0x7f6e5c00f790
  577. 2017-10-03 11:09:58.491400 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  578. 2017-10-03 11:09:58.491544 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:31 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2097152~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  579. 2017-10-03 11:09:58.491567 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  580. 2017-10-03 11:09:58.491609 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  581. 2017-10-03 11:09:58.491616 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  582. 2017-10-03 11:09:58.491994 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  583. 2017-10-03 11:09:58.492030 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 2 0x7f6e68016010 osd_op_reply(30 rbd_data.14481e238e1f29.00000000000007a1 [read 2088960~4096] v0'0 uv24009468 ondisk = 0) v8
  584. 2017-10-03 11:09:58.492043 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 2 ==== osd_op_reply(30 rbd_data.14481e238e1f29.00000000000007a1 [read 2088960~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (1073653682 0 4195595866) 0x7f6e68016010 con 0x7f6e5c015e80
  585. 2017-10-03 11:09:58.492063 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  586. 2017-10-03 11:09:58.492238 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:32 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2097152~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  587. 2017-10-03 11:09:58.492278 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  588. 2017-10-03 11:09:58.492300 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  589. 2017-10-03 11:09:58.492320 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 3 0x7f6e68016010 osd_op_reply(31 rbd_data.14481e238e1f29.00000000000007a1 [read 2097152~4096] v0'0 uv24009468 ondisk = 0) v8
  590. 2017-10-03 11:09:58.492329 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 3 ==== osd_op_reply(31 rbd_data.14481e238e1f29.00000000000007a1 [read 2097152~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (3058338075 0 4122019889) 0x7f6e68016010 con 0x7f6e5c015e80
  591. 2017-10-03 11:09:58.492347 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  592. 2017-10-03 11:09:58.492367 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  593. 2017-10-03 11:09:58.492374 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  594. 2017-10-03 11:09:58.492522 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:33 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2101248~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  595. 2017-10-03 11:09:58.492562 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  596. 2017-10-03 11:09:58.492619 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  597. 2017-10-03 11:09:58.492628 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  598. 2017-10-03 11:09:58.493330 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  599. 2017-10-03 11:09:58.493331 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  600. 2017-10-03 11:09:58.493365 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 4 0x7f6e6801a1b0 osd_op_reply(33 rbd_data.14481e238e1f29.00000000000007a1 [read 2101248~4096] v0'0 uv24009468 ondisk = 0) v8
  601. 2017-10-03 11:09:58.493366 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 5 0x7f6e7000f850 osd_op_reply(32 rbd_data.14481e238e1f29.000000000000003d [read 2097152~4096] v0'0 uv25292674 ondisk = 0) v8
  602. 2017-10-03 11:09:58.493377 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 5 ==== osd_op_reply(32 rbd_data.14481e238e1f29.000000000000003d [read 2097152~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (691893928 0 2099392586) 0x7f6e7000f850 con 0x7f6e5c008a70
  603. 2017-10-03 11:09:58.493376 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 4 ==== osd_op_reply(33 rbd_data.14481e238e1f29.00000000000007a1 [read 2101248~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (2005621722 0 181131536) 0x7f6e6801a1b0 con 0x7f6e5c015e80
  604. 2017-10-03 11:09:58.493400 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  605. 2017-10-03 11:09:58.493403 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  606. 2017-10-03 11:09:58.493577 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:34 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2101248~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  607. 2017-10-03 11:09:58.493629 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:35 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 2093056~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01d670 con 0
  608. 2017-10-03 11:09:58.493662 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  609. 2017-10-03 11:09:58.493724 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  610. 2017-10-03 11:09:58.493730 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  611. 2017-10-03 11:09:58.493760 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  612. 2017-10-03 11:09:58.493829 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  613. 2017-10-03 11:09:58.493836 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01d670 done.
  614. 2017-10-03 11:09:58.494526 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  615. 2017-10-03 11:09:58.494565 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 6 0x7f6e700114d0 osd_op_reply(34 rbd_data.14481e238e1f29.000000000000003d [read 2101248~4096] v0'0 uv25292674 ondisk = 0) v8
  616. 2017-10-03 11:09:58.494577 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 6 ==== osd_op_reply(34 rbd_data.14481e238e1f29.000000000000003d [read 2101248~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (3908871273 0 3292702620) 0x7f6e700114d0 con 0x7f6e5c008a70
  617. 2017-10-03 11:09:58.494605 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  618. 2017-10-03 11:09:58.494692 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  619. 2017-10-03 11:09:58.494740 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 5 0x7f6e74021b50 osd_op_reply(35 rbd_data.14481e238e1f29.00000000000007ff [read 2093056~4096] v0'0 uv22140457 ondisk = 0) v8
  620. 2017-10-03 11:09:58.494748 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 5 ==== osd_op_reply(35 rbd_data.14481e238e1f29.00000000000007ff [read 2093056~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (1095827497 0 1149555132) 0x7f6e74021b50 con 0x7f6e5c00f790
  621. 2017-10-03 11:09:58.494769 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  622. 2017-10-03 11:09:58.494885 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:36 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2093056~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  623. 2017-10-03 11:09:58.494915 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  624. 2017-10-03 11:09:58.494940 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:37 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1961984~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01dcf0 con 0
  625. 2017-10-03 11:09:58.494958 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  626. 2017-10-03 11:09:58.495009 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  627. 2017-10-03 11:09:58.495014 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  628. 2017-10-03 11:09:58.495026 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  629. 2017-10-03 11:09:58.495034 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01dcf0 done.
  630. 2017-10-03 11:09:58.495745 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  631. 2017-10-03 11:09:58.495779 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 5 0x7f6e6801c010 osd_op_reply(36 rbd_data.14481e238e1f29.00000000000007a1 [read 2093056~4096] v0'0 uv24009468 ondisk = 0) v8
  632. 2017-10-03 11:09:58.495786 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 5 ==== osd_op_reply(36 rbd_data.14481e238e1f29.00000000000007a1 [read 2093056~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (4265571699 0 439445982) 0x7f6e6801c010 con 0x7f6e5c015e80
  633. 2017-10-03 11:09:58.495814 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  634. 2017-10-03 11:09:58.495847 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  635. 2017-10-03 11:09:58.495871 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 6 0x7f6e74023740 osd_op_reply(37 rbd_data.14481e238e1f29.00000000000007ff [read 1961984~4096] v0'0 uv22140457 ondisk = 0) v8
  636. 2017-10-03 11:09:58.495879 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 6 ==== osd_op_reply(37 rbd_data.14481e238e1f29.00000000000007ff [read 1961984~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (147816593 0 2798809291) 0x7f6e74023740 con 0x7f6e5c00f790
  637. 2017-10-03 11:09:58.495893 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  638. 2017-10-03 11:09:58.495987 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:38 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1961984~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  639. 2017-10-03 11:09:58.496008 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  640. 2017-10-03 11:09:58.496020 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:39 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 2064384~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01e250 con 0
  641. 2017-10-03 11:09:58.496035 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  642. 2017-10-03 11:09:58.496052 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  643. 2017-10-03 11:09:58.496056 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  644. 2017-10-03 11:09:58.496089 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  645. 2017-10-03 11:09:58.496093 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01e250 done.
  646. 2017-10-03 11:09:58.496709 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  647. 2017-10-03 11:09:58.496725 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 6 0x7f6e6801ca40 osd_op_reply(38 rbd_data.14481e238e1f29.00000000000007a1 [read 1961984~4096] v0'0 uv24009468 ondisk = 0) v8
  648. 2017-10-03 11:09:58.496730 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 6 ==== osd_op_reply(38 rbd_data.14481e238e1f29.00000000000007a1 [read 1961984~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (3080844747 0 866203007) 0x7f6e6801ca40 con 0x7f6e5c015e80
  649. 2017-10-03 11:09:58.496742 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  650. 2017-10-03 11:09:58.496830 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  651. 2017-10-03 11:09:58.496847 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 7 0x7f6e74025330 osd_op_reply(39 rbd_data.14481e238e1f29.00000000000007ff [read 2064384~4096] v0'0 uv22140457 ondisk = 0) v8
  652. 2017-10-03 11:09:58.496852 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 7 ==== osd_op_reply(39 rbd_data.14481e238e1f29.00000000000007ff [read 2064384~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (265081228 0 4161162335) 0x7f6e74025330 con 0x7f6e5c00f790
  653. 2017-10-03 11:09:58.496862 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  654. 2017-10-03 11:09:58.496862 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:40 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2064384~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  655. 2017-10-03 11:09:58.496879 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  656. 2017-10-03 11:09:58.496944 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  657. 2017-10-03 11:09:58.496949 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  658. 2017-10-03 11:09:58.496962 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:41 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1966080~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01e7b0 con 0
  659. 2017-10-03 11:09:58.496979 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  660. 2017-10-03 11:09:58.497013 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  661. 2017-10-03 11:09:58.497017 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01e7b0 done.
  662. 2017-10-03 11:09:58.497598 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  663. 2017-10-03 11:09:58.497612 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 7 0x7f6e6801e6b0 osd_op_reply(40 rbd_data.14481e238e1f29.00000000000007a1 [read 2064384~4096] v0'0 uv24009468 ondisk = 0) v8
  664. 2017-10-03 11:09:58.497616 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 7 ==== osd_op_reply(40 rbd_data.14481e238e1f29.00000000000007a1 [read 2064384~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (2963449046 0 2780833489) 0x7f6e6801e6b0 con 0x7f6e5c015e80
  665. 2017-10-03 11:09:58.497627 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  666. 2017-10-03 11:09:58.497725 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:42 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1966080~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01d700 con 0
  667. 2017-10-03 11:09:58.497751 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  668. 2017-10-03 11:09:58.497761 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  669. 2017-10-03 11:09:58.497786 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 8 0x7f6e74029010 osd_op_reply(41 rbd_data.14481e238e1f29.00000000000007ff [read 1966080~4096] v0'0 uv22140457 ondisk = 0) v8
  670. 2017-10-03 11:09:58.497794 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 8 ==== osd_op_reply(41 rbd_data.14481e238e1f29.00000000000007ff [read 1966080~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (962867710 0 903455028) 0x7f6e74029010 con 0x7f6e5c00f790
  671. 2017-10-03 11:09:58.497812 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  672. 2017-10-03 11:09:58.497812 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  673. 2017-10-03 11:09:58.497817 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01d700 done.
  674. 2017-10-03 11:09:58.497892 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:43 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1892352~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01d700 con 0
  675. 2017-10-03 11:09:58.497906 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  676. 2017-10-03 11:09:58.497942 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  677. 2017-10-03 11:09:58.497946 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01d700 done.
  678. 2017-10-03 11:09:58.498577 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  679. 2017-10-03 11:09:58.498583 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  680. 2017-10-03 11:09:58.498610 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 9 0x7f6e74029c50 osd_op_reply(43 rbd_data.14481e238e1f29.00000000000007ff [read 1892352~4096] v0'0 uv22140457 ondisk = 0) v8
  681. 2017-10-03 11:09:58.498610 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 8 0x7f6e68020370 osd_op_reply(42 rbd_data.14481e238e1f29.00000000000007a1 [read 1966080~4096] v0'0 uv24009468 ondisk = 0) v8
  682. 2017-10-03 11:09:58.498618 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 9 ==== osd_op_reply(43 rbd_data.14481e238e1f29.00000000000007ff [read 1892352~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (3988853260 0 1034071702) 0x7f6e74029c50 con 0x7f6e5c00f790
  683. 2017-10-03 11:09:58.498619 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 8 ==== osd_op_reply(42 rbd_data.14481e238e1f29.00000000000007a1 [read 1966080~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (2248819876 0 1297129038) 0x7f6e68020370 con 0x7f6e5c015e80
  684. 2017-10-03 11:09:58.498641 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  685. 2017-10-03 11:09:58.498642 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  686. 2017-10-03 11:09:58.498771 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:44 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1794048~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01c7f0 con 0
  687. 2017-10-03 11:09:58.498789 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  688. 2017-10-03 11:09:58.498809 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:45 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1892352~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01f5c0 con 0
  689. 2017-10-03 11:09:58.498822 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  690. 2017-10-03 11:09:58.498861 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  691. 2017-10-03 11:09:58.498866 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01f5c0 done.
  692. 2017-10-03 11:09:58.498869 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  693. 2017-10-03 11:09:58.498873 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01c7f0 done.
  694. 2017-10-03 11:09:58.499472 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  695. 2017-10-03 11:09:58.499510 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 10 0x7f6e7402b8b0 osd_op_reply(44 rbd_data.14481e238e1f29.00000000000007ff [read 1794048~4096] v0'0 uv22140457 ondisk = 0) v8
  696. 2017-10-03 11:09:58.499546 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 10 ==== osd_op_reply(44 rbd_data.14481e238e1f29.00000000000007ff [read 1794048~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (30045110 0 1754609190) 0x7f6e7402b8b0 con 0x7f6e5c00f790
  697. 2017-10-03 11:09:58.499547 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  698. 2017-10-03 11:09:58.499566 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 9 0x7f6e68022010 osd_op_reply(45 rbd_data.14481e238e1f29.00000000000007a1 [read 1892352~4096] v0'0 uv24009468 ondisk = 0) v8
  699. 2017-10-03 11:09:58.499573 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 9 ==== osd_op_reply(45 rbd_data.14481e238e1f29.00000000000007a1 [read 1892352~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (1387226966 0 3478992319) 0x7f6e68022010 con 0x7f6e5c015e80
  700. 2017-10-03 11:09:58.499577 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  701. 2017-10-03 11:09:58.499585 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  702. 2017-10-03 11:09:58.499748 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:46 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1748992~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01d700 con 0
  703. 2017-10-03 11:09:58.499772 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  704. 2017-10-03 11:09:58.499793 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:47 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1794048~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01fdf0 con 0
  705. 2017-10-03 11:09:58.499811 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  706. 2017-10-03 11:09:58.499839 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  707. 2017-10-03 11:09:58.499845 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c01d700 done.
  708. 2017-10-03 11:09:58.499855 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  709. 2017-10-03 11:09:58.499861 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01fdf0 done.
  710. 2017-10-03 11:09:58.500566 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  711. 2017-10-03 11:09:58.500598 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 10 0x7f6e68022c50 osd_op_reply(47 rbd_data.14481e238e1f29.00000000000007a1 [read 1794048~4096] v0'0 uv24009468 ondisk = 0) v8
  712. 2017-10-03 11:09:58.500606 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 10 ==== osd_op_reply(47 rbd_data.14481e238e1f29.00000000000007a1 [read 1794048~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (3198420716 0 3186767262) 0x7f6e68022c50 con 0x7f6e5c015e80
  713. 2017-10-03 11:09:58.500650 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  714. 2017-10-03 11:09:58.500654 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  715. 2017-10-03 11:09:58.500669 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 11 0x7f6e7402d4d0 osd_op_reply(46 rbd_data.14481e238e1f29.00000000000007ff [read 1748992~4096] v0'0 uv22140457 ondisk = 0) v8
  716. 2017-10-03 11:09:58.500676 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 11 ==== osd_op_reply(46 rbd_data.14481e238e1f29.00000000000007ff [read 1748992~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (4287664402 0 1722496057) 0x7f6e7402d4d0 con 0x7f6e5c00f790
  717. 2017-10-03 11:09:58.500690 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  718. 2017-10-03 11:09:58.500797 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:48 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1748992~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c01d700 con 0
  719. 2017-10-03 11:09:58.500817 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  720. 2017-10-03 11:09:58.500830 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:49 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1720320~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c020620 con 0
  721. 2017-10-03 11:09:58.500844 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  722. 2017-10-03 11:09:58.500877 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  723. 2017-10-03 11:09:58.500882 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c01d700 done.
  724. 2017-10-03 11:09:58.500892 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  725. 2017-10-03 11:09:58.500896 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c020620 done.
  726. 2017-10-03 11:09:58.501495 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  727. 2017-10-03 11:09:58.501534 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 12 0x7f6e7402f1b0 osd_op_reply(49 rbd_data.14481e238e1f29.00000000000007ff [read 1720320~4096] v0'0 uv22140457 ondisk = 0) v8
  728. 2017-10-03 11:09:58.501541 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 12 ==== osd_op_reply(49 rbd_data.14481e238e1f29.00000000000007ff [read 1720320~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (2741690521 0 4172649146) 0x7f6e7402f1b0 con 0x7f6e5c00f790
  729. 2017-10-03 11:09:58.501554 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  730. 2017-10-03 11:09:58.501655 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  731. 2017-10-03 11:09:58.501667 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:50 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1630208~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c020350 con 0
  732. 2017-10-03 11:09:58.501681 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 11 0x7f6e68024700 osd_op_reply(48 rbd_data.14481e238e1f29.00000000000007a1 [read 1748992~4096] v0'0 uv24009468 ondisk = 0) v8
  733. 2017-10-03 11:09:58.501683 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  734. 2017-10-03 11:09:58.501687 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 11 ==== osd_op_reply(48 rbd_data.14481e238e1f29.00000000000007a1 [read 1748992~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (1090446408 0 3709118115) 0x7f6e68024700 con 0x7f6e5c015e80
  735. 2017-10-03 11:09:58.501697 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  736. 2017-10-03 11:09:58.501725 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  737. 2017-10-03 11:09:58.501730 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c020350 done.
  738. 2017-10-03 11:09:58.501787 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:51 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1720320~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c020b70 con 0
  739. 2017-10-03 11:09:58.501808 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  740. 2017-10-03 11:09:58.501843 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  741. 2017-10-03 11:09:58.501849 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c020b70 done.
  742. 2017-10-03 11:09:58.502379 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  743. 2017-10-03 11:09:58.502403 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 13 0x7f6e74031010 osd_op_reply(50 rbd_data.14481e238e1f29.00000000000007ff [read 1630208~4096] v0'0 uv22140457 ondisk = 0) v8
  744. 2017-10-03 11:09:58.502409 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 13 ==== osd_op_reply(50 rbd_data.14481e238e1f29.00000000000007ff [read 1630208~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (2130449276 0 1746114718) 0x7f6e74031010 con 0x7f6e5c00f790
  745. 2017-10-03 11:09:58.502421 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  746. 2017-10-03 11:09:58.502532 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:52 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1597440~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c020b70 con 0
  747. 2017-10-03 11:09:58.502539 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  748. 2017-10-03 11:09:58.502552 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  749. 2017-10-03 11:09:58.502555 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 12 0x7f6e68026330 osd_op_reply(51 rbd_data.14481e238e1f29.00000000000007a1 [read 1720320~4096] v0'0 uv24009468 ondisk = 0) v8
  750. 2017-10-03 11:09:58.502563 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 12 ==== osd_op_reply(51 rbd_data.14481e238e1f29.00000000000007a1 [read 1720320~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (470062531 0 2903281119) 0x7f6e68026330 con 0x7f6e5c015e80
  751. 2017-10-03 11:09:58.502576 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  752. 2017-10-03 11:09:58.502586 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  753. 2017-10-03 11:09:58.502591 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c020b70 done.
  754. 2017-10-03 11:09:58.502660 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:53 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1630208~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c020b70 con 0
  755. 2017-10-03 11:09:58.502675 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  756. 2017-10-03 11:09:58.502703 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  757. 2017-10-03 11:09:58.502708 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c020b70 done.
  758. 2017-10-03 11:09:58.503265 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  759. 2017-10-03 11:09:58.503278 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 14 0x7f6e740319f0 osd_op_reply(52 rbd_data.14481e238e1f29.00000000000007ff [read 1597440~4096] v0'0 uv22140457 ondisk = 0) v8
  760. 2017-10-03 11:09:58.503283 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 14 ==== osd_op_reply(52 rbd_data.14481e238e1f29.00000000000007ff [read 1597440~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (1822143314 0 3321171289) 0x7f6e740319f0 con 0x7f6e5c00f790
  761. 2017-10-03 11:09:58.503292 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  762. 2017-10-03 11:09:58.503341 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  763. 2017-10-03 11:09:58.503363 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 13 0x7f6e68028010 osd_op_reply(53 rbd_data.14481e238e1f29.00000000000007a1 [read 1630208~4096] v0'0 uv24009468 ondisk = 0) v8
  764. 2017-10-03 11:09:58.503370 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 13 ==== osd_op_reply(53 rbd_data.14481e238e1f29.00000000000007a1 [read 1630208~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (3247597094 0 3354503517) 0x7f6e68028010 con 0x7f6e5c015e80
  765. 2017-10-03 11:09:58.503382 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  766. 2017-10-03 11:09:58.503377 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:54 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1589248~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0214e0 con 0
  767. 2017-10-03 11:09:58.503393 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  768. 2017-10-03 11:09:58.503424 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  769. 2017-10-03 11:09:58.503431 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c0214e0 done.
  770. 2017-10-03 11:09:58.503477 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:55 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1597440~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c021a20 con 0
  771. 2017-10-03 11:09:58.503494 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  772. 2017-10-03 11:09:58.503543 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  773. 2017-10-03 11:09:58.503548 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c021a20 done.
  774. 2017-10-03 11:09:58.504077 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  775. 2017-10-03 11:09:58.504102 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 15 0x7f6e74035510 osd_op_reply(54 rbd_data.14481e238e1f29.00000000000007ff [read 1589248~4096] v0'0 uv22140457 ondisk = 0) v8
  776. 2017-10-03 11:09:58.504108 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 15 ==== osd_op_reply(54 rbd_data.14481e238e1f29.00000000000007ff [read 1589248~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (3941883937 0 967021878) 0x7f6e74035510 con 0x7f6e5c00f790
  777. 2017-10-03 11:09:58.504122 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  778. 2017-10-03 11:09:58.504225 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:56 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1609728~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c021a20 con 0
  779. 2017-10-03 11:09:58.504245 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  780. 2017-10-03 11:09:58.504252 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  781. 2017-10-03 11:09:58.504262 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 14 0x7f6e68028ac0 osd_op_reply(55 rbd_data.14481e238e1f29.00000000000007a1 [read 1597440~4096] v0'0 uv24009468 ondisk = 0) v8
  782. 2017-10-03 11:09:58.504267 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 14 ==== osd_op_reply(55 rbd_data.14481e238e1f29.00000000000007a1 [read 1597440~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (3556099592 0 2135503412) 0x7f6e68028ac0 con 0x7f6e5c015e80
  783. 2017-10-03 11:09:58.504276 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  784. 2017-10-03 11:09:58.504320 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  785. 2017-10-03 11:09:58.504326 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c021a20 done.
  786. 2017-10-03 11:09:58.504394 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:57 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1589248~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c021a20 con 0
  787. 2017-10-03 11:09:58.504413 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  788. 2017-10-03 11:09:58.504457 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  789. 2017-10-03 11:09:58.504461 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c021a20 done.
  790. 2017-10-03 11:09:58.505027 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  791. 2017-10-03 11:09:58.505031 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  792. 2017-10-03 11:09:58.505090 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 16 0x7f6e74033010 osd_op_reply(56 rbd_data.14481e238e1f29.00000000000007ff [read 1609728~4096] v0'0 uv22140457 ondisk = 0) v8
  793. 2017-10-03 11:09:58.505090 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 15 0x7f6e6802a590 osd_op_reply(57 rbd_data.14481e238e1f29.00000000000007a1 [read 1589248~4096] v0'0 uv24009468 ondisk = 0) v8
  794. 2017-10-03 11:09:58.505099 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 16 ==== osd_op_reply(56 rbd_data.14481e238e1f29.00000000000007ff [read 1609728~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (811713241 0 839648949) 0x7f6e74033010 con 0x7f6e5c00f790
  795. 2017-10-03 11:09:58.505099 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 15 ==== osd_op_reply(57 rbd_data.14481e238e1f29.00000000000007a1 [read 1589248~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (1436161403 0 1101485447) 0x7f6e6802a590 con 0x7f6e5c015e80
  796. 2017-10-03 11:09:58.505122 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  797. 2017-10-03 11:09:58.505123 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  798. 2017-10-03 11:09:58.505265 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:58 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1609728~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c021a20 con 0
  799. 2017-10-03 11:09:58.505284 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  800. 2017-10-03 11:09:58.505296 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:59 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 516096~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0227d0 con 0
  801. 2017-10-03 11:09:58.505312 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  802. 2017-10-03 11:09:58.505365 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  803. 2017-10-03 11:09:58.505369 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c021a20 done.
  804. 2017-10-03 11:09:58.505376 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  805. 2017-10-03 11:09:58.505380 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c0227d0 done.
  806. 2017-10-03 11:09:58.506116 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  807. 2017-10-03 11:09:58.506116 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  808. 2017-10-03 11:09:58.506167 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 17 0x7f6e74033bd0 osd_op_reply(59 rbd_data.14481e238e1f29.00000000000007ff [read 516096~4096] v0'0 uv22140457 ondisk = 0) v8
  809. 2017-10-03 11:09:58.506167 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 16 0x7f6e6802e170 osd_op_reply(58 rbd_data.14481e238e1f29.00000000000007a1 [read 1609728~4096] v0'0 uv24009468 ondisk = 0) v8
  810. 2017-10-03 11:09:58.506176 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 17 ==== osd_op_reply(59 rbd_data.14481e238e1f29.00000000000007ff [read 516096~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (3827977947 0 4113000151) 0x7f6e74033bd0 con 0x7f6e5c00f790
  811. 2017-10-03 11:09:58.506177 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 16 ==== osd_op_reply(58 rbd_data.14481e238e1f29.00000000000007a1 [read 1609728~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (2400171907 0 1958155550) 0x7f6e6802e170 con 0x7f6e5c015e80
  812. 2017-10-03 11:09:58.506198 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  813. 2017-10-03 11:09:58.506200 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  814. 2017-10-03 11:09:58.506321 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:60 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 516096~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c021a20 con 0
  815. 2017-10-03 11:09:58.506339 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  816. 2017-10-03 11:09:58.506365 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:61 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 3145728~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c022fd0 con 0
  817. 2017-10-03 11:09:58.506400 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  818. 2017-10-03 11:09:58.506408 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c021a20 done.
  819. 2017-10-03 11:09:58.506430 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  820. 2017-10-03 11:09:58.506436 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c022fd0 done.
  821. 2017-10-03 11:09:58.506444 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  822. 2017-10-03 11:09:58.507079 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  823. 2017-10-03 11:09:58.507109 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 17 0x7f6e68030150 osd_op_reply(60 rbd_data.14481e238e1f29.00000000000007a1 [read 516096~4096] v0'0 uv24009468 ondisk = 0) v8
  824. 2017-10-03 11:09:58.507117 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 17 ==== osd_op_reply(60 rbd_data.14481e238e1f29.00000000000007a1 [read 516096~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (1531198337 0 3213531923) 0x7f6e68030150 con 0x7f6e5c015e80
  825. 2017-10-03 11:09:58.507136 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  826. 2017-10-03 11:09:58.507209 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  827. 2017-10-03 11:09:58.507228 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 18 0x7f6e68030b30 osd_op_reply(61 rbd_data.14481e238e1f29.00000000000007a1 [read 3145728~4096] v0'0 uv24009468 ondisk = 0) v8
  828. 2017-10-03 11:09:58.507234 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 18 ==== osd_op_reply(61 rbd_data.14481e238e1f29.00000000000007a1 [read 3145728~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (4050018617 0 2030197327) 0x7f6e68030b30 con 0x7f6e5c015e80
  829. 2017-10-03 11:09:58.507247 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  830. 2017-10-03 11:09:58.507264 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:62 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 3145728~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c021a20 con 0
  831. 2017-10-03 11:09:58.507288 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  832. 2017-10-03 11:09:58.507330 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  833. 2017-10-03 11:09:58.507334 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c021a20 done.
  834. 2017-10-03 11:09:58.507387 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:63 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023500 con 0
  835. 2017-10-03 11:09:58.507404 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  836. 2017-10-03 11:09:58.507442 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  837. 2017-10-03 11:09:58.507448 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c023500 done.
  838. 2017-10-03 11:09:58.508197 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  839. 2017-10-03 11:09:58.508202 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  840. 2017-10-03 11:09:58.508228 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 7 0x7f6e70015010 osd_op_reply(62 rbd_data.14481e238e1f29.000000000000003d [read 3145728~4096] v0'0 uv25292674 ondisk = 0) v8
  841. 2017-10-03 11:09:58.508228 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 19 0x7f6e680321d0 osd_op_reply(63 rbd_data.14481e238e1f29.00000000000007a1 [read 2109440~4096] v0'0 uv24009468 ondisk = 0) v8
  842. 2017-10-03 11:09:58.508236 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 7 ==== osd_op_reply(62 rbd_data.14481e238e1f29.000000000000003d [read 3145728~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (1846648458 0 2534570520) 0x7f6e70015010 con 0x7f6e5c008a70
  843. 2017-10-03 11:09:58.508236 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 19 ==== osd_op_reply(63 rbd_data.14481e238e1f29.00000000000007a1 [read 2109440~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (4058286249 0 181131536) 0x7f6e680321d0 con 0x7f6e5c015e80
  844. 2017-10-03 11:09:58.508255 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  845. 2017-10-03 11:09:58.508257 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  846. 2017-10-03 11:09:58.508421 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:64 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2109440~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023500 con 0
  847. 2017-10-03 11:09:58.508442 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  848. 2017-10-03 11:09:58.508466 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:65 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2125824~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023ea0 con 0
  849. 2017-10-03 11:09:58.508484 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  850. 2017-10-03 11:09:58.508484 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  851. 2017-10-03 11:09:58.508489 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c023500 done.
  852. 2017-10-03 11:09:58.508527 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  853. 2017-10-03 11:09:58.508535 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c023ea0 done.
  854. 2017-10-03 11:09:58.509299 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  855. 2017-10-03 11:09:58.509305 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  856. 2017-10-03 11:09:58.509353 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 8 0x7f6e70017010 osd_op_reply(64 rbd_data.14481e238e1f29.000000000000003d [read 2109440~4096] v0'0 uv25292674 ondisk = 0) v8
  857. 2017-10-03 11:09:58.509353 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 20 0x7f6e68034010 osd_op_reply(65 rbd_data.14481e238e1f29.00000000000007a1 [read 2125824~4096] v0'0 uv24009468 ondisk = 0) v8
  858. 2017-10-03 11:09:58.509367 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 8 ==== osd_op_reply(64 rbd_data.14481e238e1f29.000000000000003d [read 2109440~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (1855158042 0 3063581664) 0x7f6e70017010 con 0x7f6e5c008a70
  859. 2017-10-03 11:09:58.509369 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 20 ==== osd_op_reply(65 rbd_data.14481e238e1f29.00000000000007a1 [read 2125824~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (4174862526 0 3505222503) 0x7f6e68034010 con 0x7f6e5c015e80
  860. 2017-10-03 11:09:58.509403 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  861. 2017-10-03 11:09:58.509404 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  862. 2017-10-03 11:09:58.509565 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:66 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2125824~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023500 con 0
  863. 2017-10-03 11:09:58.509585 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  864. 2017-10-03 11:09:58.509598 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:67 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2158592~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0246a0 con 0
  865. 2017-10-03 11:09:58.509617 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  866. 2017-10-03 11:09:58.509638 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  867. 2017-10-03 11:09:58.509642 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c023500 done.
  868. 2017-10-03 11:09:58.509666 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  869. 2017-10-03 11:09:58.509678 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0246a0 done.
  870. 2017-10-03 11:09:58.510450 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  871. 2017-10-03 11:09:58.510480 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  872. 2017-10-03 11:09:58.510502 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 9 0x7f6e70017900 osd_op_reply(66 rbd_data.14481e238e1f29.000000000000003d [read 2125824~4096] v0'0 uv25292674 ondisk = 0) v8
  873. 2017-10-03 11:09:58.510513 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 9 ==== osd_op_reply(66 rbd_data.14481e238e1f29.000000000000003d [read 2125824~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (1738581773 0 512653225) 0x7f6e70017900 con 0x7f6e5c008a70
  874. 2017-10-03 11:09:58.510524 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 21 0x7f6e68034850 osd_op_reply(67 rbd_data.14481e238e1f29.00000000000007a1 [read 2158592~4096] v0'0 uv24009468 ondisk = 0) v8
  875. 2017-10-03 11:09:58.510535 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 21 ==== osd_op_reply(67 rbd_data.14481e238e1f29.00000000000007a1 [read 2158592~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (3937466512 0 3666987010) 0x7f6e68034850 con 0x7f6e5c015e80
  876. 2017-10-03 11:09:58.510541 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  877. 2017-10-03 11:09:58.510554 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  878. 2017-10-03 11:09:58.510723 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:68 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2158592~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023500 con 0
  879. 2017-10-03 11:09:58.510749 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  880. 2017-10-03 11:09:58.510771 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:69 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2105344~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c024bc0 con 0
  881. 2017-10-03 11:09:58.510792 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  882. 2017-10-03 11:09:58.510806 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:70 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2113536~12288] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0258f0 con 0
  883. 2017-10-03 11:09:58.510826 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  884. 2017-10-03 11:09:58.510832 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c023500 done.
  885. 2017-10-03 11:09:58.510839 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:71 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2129920~28672] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023500 con 0
  886. 2017-10-03 11:09:58.510846 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  887. 2017-10-03 11:09:58.510854 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c024bc0 done.
  888. 2017-10-03 11:09:58.510885 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  889. 2017-10-03 11:09:58.510884 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:72 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2162688~73728] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c027950 con 0
  890. 2017-10-03 11:09:58.510891 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0258f0 done.
  891. 2017-10-03 11:09:58.510909 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  892. 2017-10-03 11:09:58.510912 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c023500 done.
  893. 2017-10-03 11:09:58.510927 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  894. 2017-10-03 11:09:58.510934 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c027950 done.
  895. 2017-10-03 11:09:58.510941 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  896. 2017-10-03 11:09:58.510946 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  897. 2017-10-03 11:09:58.510952 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  898. 2017-10-03 11:09:58.511581 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  899. 2017-10-03 11:09:58.511588 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  900. 2017-10-03 11:09:58.511613 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 22 0x7f6e68038150 osd_op_reply(69 rbd_data.14481e238e1f29.00000000000007a1 [read 2105344~4096] v0'0 uv24009468 ondisk = 0) v8
  901. 2017-10-03 11:09:58.511613 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 10 0x7f6e700195d0 osd_op_reply(68 rbd_data.14481e238e1f29.000000000000003d [read 2158592~4096] v0'0 uv25292674 ondisk = 0) v8
  902. 2017-10-03 11:09:58.511621 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 22 ==== osd_op_reply(69 rbd_data.14481e238e1f29.00000000000007a1 [read 2105344~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (807754344 0 1306877150) 0x7f6e68038150 con 0x7f6e5c015e80
  903. 2017-10-03 11:09:58.511623 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 10 ==== osd_op_reply(68 rbd_data.14481e238e1f29.000000000000003d [read 2158592~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (1975977763 0 1263270346) 0x7f6e700195d0 con 0x7f6e5c008a70
  904. 2017-10-03 11:09:58.511642 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  905. 2017-10-03 11:09:58.511645 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  906. 2017-10-03 11:09:58.511864 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:73 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2105344~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c023500 con 0
  907. 2017-10-03 11:09:58.511887 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  908. 2017-10-03 11:09:58.511902 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:74 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2113536~12288] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  909. 2017-10-03 11:09:58.511933 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:75 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2129920~28672] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  910. 2017-10-03 11:09:58.511938 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  911. 2017-10-03 11:09:58.511944 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c023500 done.
  912. 2017-10-03 11:09:58.511957 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  913. 2017-10-03 11:09:58.511960 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  914. 2017-10-03 11:09:58.511959 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:76 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2162688~73728] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c029de0 con 0
  915. 2017-10-03 11:09:58.511980 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  916. 2017-10-03 11:09:58.511986 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  917. 2017-10-03 11:09:58.512002 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  918. 2017-10-03 11:09:58.512006 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c029de0 done.
  919. 2017-10-03 11:09:58.512011 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  920. 2017-10-03 11:09:58.512015 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  921. 2017-10-03 11:09:58.512017 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  922. 2017-10-03 11:09:58.512747 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  923. 2017-10-03 11:09:58.512804 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 11 0x7f6e7001d010 osd_op_reply(73 rbd_data.14481e238e1f29.000000000000003d [read 2105344~4096] v0'0 uv25292674 ondisk = 0) v8
  924. 2017-10-03 11:09:58.512817 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 11 ==== osd_op_reply(73 rbd_data.14481e238e1f29.000000000000003d [read 2105344~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (2941429211 0 3722750286) 0x7f6e7001d010 con 0x7f6e5c008a70
  925. 2017-10-03 11:09:58.512834 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  926. 2017-10-03 11:09:58.513039 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  927. 2017-10-03 11:09:58.513059 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 12 0x7f6e7001d9a0 osd_op_reply(74 rbd_data.14481e238e1f29.000000000000003d [read 2113536~12288] v0'0 uv25292674 ondisk = 0) v8
  928. 2017-10-03 11:09:58.513076 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 12 ==== osd_op_reply(74 rbd_data.14481e238e1f29.000000000000003d [read 2113536~12288] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+12288 (899624961 0 1558119184) 0x7f6e7001d9a0 con 0x7f6e5c008a70
  929. 2017-10-03 11:09:58.513086 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 12472 to dispatch throttler 12472/104857600
  930. 2017-10-03 11:09:58.513371 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  931. 2017-10-03 11:09:58.513409 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 13 0x7f6e7001f1d0 osd_op_reply(75 rbd_data.14481e238e1f29.000000000000003d [read 2129920~28672] v0'0 uv25292674 ondisk = 0) v8
  932. 2017-10-03 11:09:58.513416 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 13 ==== osd_op_reply(75 rbd_data.14481e238e1f29.000000000000003d [read 2129920~28672] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+28672 (99118404 0 3988175158) 0x7f6e7001f1d0 con 0x7f6e5c008a70
  933. 2017-10-03 11:09:58.513425 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 28856 to dispatch throttler 28856/104857600
  934. 2017-10-03 11:09:58.513979 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  935. 2017-10-03 11:09:58.514044 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 14 0x7f6e7001f8b0 osd_op_reply(76 rbd_data.14481e238e1f29.000000000000003d [read 2162688~73728] v0'0 uv25292674 ondisk = 0) v8
  936. 2017-10-03 11:09:58.514051 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 14 ==== osd_op_reply(76 rbd_data.14481e238e1f29.000000000000003d [read 2162688~73728] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+73728 (3190284005 0 1366567063) 0x7f6e7001f8b0 con 0x7f6e5c008a70
  937. 2017-10-03 11:09:58.514067 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 73912 to dispatch throttler 73912/104857600
  938. 2017-10-03 11:09:58.514276 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:77 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2236416~122880] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c029de0 con 0
  939. 2017-10-03 11:09:58.514301 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  940. 2017-10-03 11:09:58.514354 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  941. 2017-10-03 11:09:58.514359 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c029de0 done.
  942. 2017-10-03 11:09:58.516364 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  943. 2017-10-03 11:09:58.516414 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 15 0x7f6e7002b170 osd_op_reply(77 rbd_data.14481e238e1f29.000000000000003d [read 2236416~122880] v0'0 uv25292674 ondisk = 0) v8
  944. 2017-10-03 11:09:58.516419 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 15 ==== osd_op_reply(77 rbd_data.14481e238e1f29.000000000000003d [read 2236416~122880] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+122880 (679262966 0 146660901) 0x7f6e7002b170 con 0x7f6e5c008a70
  945. 2017-10-03 11:09:58.516431 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 123064 to dispatch throttler 123064/104857600
  946. 2017-10-03 11:09:58.516775 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:78 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2359296~131072] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c029de0 con 0
  947. 2017-10-03 11:09:58.516790 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  948. 2017-10-03 11:09:58.516835 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  949. 2017-10-03 11:09:58.516839 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c029de0 done.
  950. 2017-10-03 11:09:58.518793 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  951. 2017-10-03 11:09:58.518815 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 16 0x7f6e70023010 osd_op_reply(78 rbd_data.14481e238e1f29.000000000000003d [read 2359296~131072] v0'0 uv25292674 ondisk = 0) v8
  952. 2017-10-03 11:09:58.518821 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 16 ==== osd_op_reply(78 rbd_data.14481e238e1f29.000000000000003d [read 2359296~131072] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+131072 (3963462038 0 2002153908) 0x7f6e70023010 con 0x7f6e5c008a70
  953. 2017-10-03 11:09:58.518829 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 131256 to dispatch throttler 131256/104857600
  954. 2017-10-03 11:09:58.518971 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:79 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 2490368~131072] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c029de0 con 0
  955. 2017-10-03 11:09:58.518983 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  956. 2017-10-03 11:09:58.519007 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  957. 2017-10-03 11:09:58.519011 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c029de0 done.
  958. 2017-10-03 11:09:58.521235 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  959. 2017-10-03 11:09:58.521266 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 17 0x7f6e700239b0 osd_op_reply(79 rbd_data.14481e238e1f29.000000000000003d [read 2490368~131072] v0'0 uv25292674 ondisk = 0) v8
  960. 2017-10-03 11:09:58.521274 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 17 ==== osd_op_reply(79 rbd_data.14481e238e1f29.000000000000003d [read 2490368~131072] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+131072 (2778931502 0 1399254585) 0x7f6e700239b0 con 0x7f6e5c008a70
  961. 2017-10-03 11:09:58.521288 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 131256 to dispatch throttler 131256/104857600
  962. 2017-10-03 11:09:58.521543 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:80 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c029de0 con 0
  963. 2017-10-03 11:09:58.521564 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  964. 2017-10-03 11:09:58.521579 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:81 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1593344~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  965. 2017-10-03 11:09:58.521600 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:82 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1601536~8192] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  966. 2017-10-03 11:09:58.521607 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  967. 2017-10-03 11:09:58.521615 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c029de0 done.
  968. 2017-10-03 11:09:58.521621 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:83 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1613824~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02aef0 con 0
  969. 2017-10-03 11:09:58.521631 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  970. 2017-10-03 11:09:58.521634 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  971. 2017-10-03 11:09:58.521639 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:84 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1634304~69632] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  972. 2017-10-03 11:09:58.521645 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  973. 2017-10-03 11:09:58.521648 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  974. 2017-10-03 11:09:58.521662 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  975. 2017-10-03 11:09:58.521667 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02aef0 done.
  976. 2017-10-03 11:09:58.521680 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  977. 2017-10-03 11:09:58.521688 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  978. 2017-10-03 11:09:58.521696 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  979. 2017-10-03 11:09:58.521701 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  980. 2017-10-03 11:09:58.521703 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  981. 2017-10-03 11:09:58.521706 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  982. 2017-10-03 11:09:58.705572 7f6e6ffff700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).send_keepalive
  983. 2017-10-03 11:09:58.705680 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  984. 2017-10-03 11:09:58.705708 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._append_keepalive_or_ack
  985. 2017-10-03 11:09:58.705807 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 9 remaining bytes 0
  986. 2017-10-03 11:09:58.710058 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:85 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158049) v8 -- 0x7f6e50000e40 con 0
  987. 2017-10-03 11:09:58.710126 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e500017a0 con 0
  988. 2017-10-03 11:09:58.710149 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  989. 2017-10-03 11:09:58.710268 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  990. 2017-10-03 11:09:58.710293 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e500017a0 done.
  991. 2017-10-03 11:09:58.710417 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  992. 2017-10-03 11:09:58.710462 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  993. 2017-10-03 11:09:58.710478 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  994. 2017-10-03 11:09:58.711494 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  995. 2017-10-03 11:09:58.711575 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 16 0x7f6e74039010 osd_op_reply(85 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005940 ondisk = 0) v8
  996. 2017-10-03 11:09:58.711605 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 16 ==== osd_op_reply(85 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+0 (2146651683 0 0) 0x7f6e74039010 con 0x7f6e600050d0
  997. 2017-10-03 11:09:58.711642 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  998. 2017-10-03 11:09:58.717546 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  999. 2017-10-03 11:09:58.717676 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 23 0x7f6e68036010 osd_op_reply(70 rbd_data.14481e238e1f29.00000000000007a1 [read 2113536~12288] v0'0 uv24009468 ondisk = 0) v8
  1000. 2017-10-03 11:09:58.717711 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 23 ==== osd_op_reply(70 rbd_data.14481e238e1f29.00000000000007a1 [read 2113536~12288] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+12288 (2867384242 0 1311672400) 0x7f6e68036010 con 0x7f6e5c015e80
  1001. 2017-10-03 11:09:58.717947 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 12472 to dispatch throttler 12472/104857600
  1002. 2017-10-03 11:09:58.718278 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1003. 2017-10-03 11:09:58.718361 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 24 0x7f6e680366f0 osd_op_reply(71 rbd_data.14481e238e1f29.00000000000007a1 [read 2129920~28672] v0'0 uv24009468 ondisk = 0) v8
  1004. 2017-10-03 11:09:58.718388 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 24 ==== osd_op_reply(71 rbd_data.14481e238e1f29.00000000000007a1 [read 2129920~28672] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+28672 (2594149111 0 1089471409) 0x7f6e680366f0 con 0x7f6e5c015e80
  1005. 2017-10-03 11:09:58.718508 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 28856 to dispatch throttler 28856/104857600
  1006. 2017-10-03 11:09:58.719578 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1007. 2017-10-03 11:09:58.719772 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 25 0x7f6e680366f0 osd_op_reply(72 rbd_data.14481e238e1f29.00000000000007a1 [read 2162688~73728] v0'0 uv24009468 ondisk = 0) v8
  1008. 2017-10-03 11:09:58.719842 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 25 ==== osd_op_reply(72 rbd_data.14481e238e1f29.00000000000007a1 [read 2162688~73728] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+73728 (558899542 0 2034698334) 0x7f6e680366f0 con 0x7f6e5c015e80
  1009. 2017-10-03 11:09:58.719887 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 73912 to dispatch throttler 73912/104857600
  1010. 2017-10-03 11:09:58.720214 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1011. 2017-10-03 11:09:58.720322 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 26 0x7f6e6803e530 osd_op_reply(80 rbd_data.14481e238e1f29.00000000000007a1 [read 1572864~16384] v0'0 uv24009468 ondisk = 0) v8
  1012. 2017-10-03 11:09:58.720344 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 26 ==== osd_op_reply(80 rbd_data.14481e238e1f29.00000000000007a1 [read 1572864~16384] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+16384 (2101486415 0 35802133) 0x7f6e6803e530 con 0x7f6e5c015e80
  1013. 2017-10-03 11:09:58.720385 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1014. 2017-10-03 11:09:58.720516 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:86 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2236416~122880] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1015. 2017-10-03 11:09:58.720528 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1016. 2017-10-03 11:09:58.720648 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 27 0x7f6e6803ec10 osd_op_reply(81 rbd_data.14481e238e1f29.00000000000007a1 [read 1593344~4096] v0'0 uv24009468 ondisk = 0) v8
  1017. 2017-10-03 11:09:58.720667 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 27 ==== osd_op_reply(81 rbd_data.14481e238e1f29.00000000000007a1 [read 1593344~4096] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+4096 (2489042874 0 942928868) 0x7f6e6803ec10 con 0x7f6e5c015e80
  1018. 2017-10-03 11:09:58.720706 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1019. 2017-10-03 11:09:58.720761 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1020. 2017-10-03 11:09:58.720812 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 28 0x7f6e680403b0 osd_op_reply(82 rbd_data.14481e238e1f29.00000000000007a1 [read 1601536~8192] v0'0 uv24009468 ondisk = 0) v8
  1021. 2017-10-03 11:09:58.720834 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 28 ==== osd_op_reply(82 rbd_data.14481e238e1f29.00000000000007a1 [read 1601536~8192] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+8192 (225265960 0 4195200221) 0x7f6e680403b0 con 0x7f6e5c015e80
  1022. 2017-10-03 11:09:58.720868 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 8376 to dispatch throttler 8376/104857600
  1023. 2017-10-03 11:09:58.720925 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1024. 2017-10-03 11:09:58.720974 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 29 0x7f6e68040a90 osd_op_reply(83 rbd_data.14481e238e1f29.00000000000007a1 [read 1613824~16384] v0'0 uv24009468 ondisk = 0) v8
  1025. 2017-10-03 11:09:58.720996 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 29 ==== osd_op_reply(83 rbd_data.14481e238e1f29.00000000000007a1 [read 1613824~16384] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+16384 (3913961490 0 3331173477) 0x7f6e68040a90 con 0x7f6e5c015e80
  1026. 2017-10-03 11:09:58.721031 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1027. 2017-10-03 11:09:58.721186 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1028. 2017-10-03 11:09:58.721258 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 30 0x7f6e6804c1d0 osd_op_reply(84 rbd_data.14481e238e1f29.00000000000007a1 [read 1634304~69632] v0'0 uv24009468 ondisk = 0) v8
  1029. 2017-10-03 11:09:58.721283 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 30 ==== osd_op_reply(84 rbd_data.14481e238e1f29.00000000000007a1 [read 1634304~69632] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+69632 (2900295959 0 2224943631) 0x7f6e6804c1d0 con 0x7f6e5c015e80
  1030. 2017-10-03 11:09:58.721321 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 69816 to dispatch throttler 69816/104857600
  1031. 2017-10-03 11:09:58.721340 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1032. 2017-10-03 11:09:58.721471 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1033. 2017-10-03 11:09:58.721495 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1034. 2017-10-03 11:09:58.721753 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:87 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  1035. 2017-10-03 11:09:58.721814 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1036. 2017-10-03 11:09:58.721847 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:88 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1724416~24576] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1037. 2017-10-03 11:09:58.721914 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1038. 2017-10-03 11:09:58.721931 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:89 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1753088~40960] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0250e0 con 0
  1039. 2017-10-03 11:09:58.721940 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  1040. 2017-10-03 11:09:58.722048 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1041. 2017-10-03 11:09:58.722070 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1042. 2017-10-03 11:09:58.722069 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:90 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1798144~36864] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  1043. 2017-10-03 11:09:58.722141 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1044. 2017-10-03 11:09:58.722172 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0250e0 done.
  1045. 2017-10-03 11:09:58.722245 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1046. 2017-10-03 11:09:58.722281 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  1047. 2017-10-03 11:09:58.722360 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1048. 2017-10-03 11:09:58.722378 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1049. 2017-10-03 11:09:58.722388 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1050. 2017-10-03 11:09:58.724089 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1051. 2017-10-03 11:09:58.724529 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 31 0x7f6e68064c10 osd_op_reply(86 rbd_data.14481e238e1f29.00000000000007a1 [read 2236416~122880] v0'0 uv24009468 ondisk = 0) v8
  1052. 2017-10-03 11:09:58.724564 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 31 ==== osd_op_reply(86 rbd_data.14481e238e1f29.00000000000007a1 [read 2236416~122880] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+122880 (3070969157 0 1424338206) 0x7f6e68064c10 con 0x7f6e5c015e80
  1053. 2017-10-03 11:09:58.724614 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 123064 to dispatch throttler 123064/104857600
  1054. 2017-10-03 11:09:58.724696 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1055. 2017-10-03 11:09:58.724756 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 32 0x7f6e6803a530 osd_op_reply(87 rbd_data.14481e238e1f29.00000000000007a1 [read 1703936~16384] v0'0 uv24009468 ondisk = 0) v8
  1056. 2017-10-03 11:09:58.724782 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 32 ==== osd_op_reply(87 rbd_data.14481e238e1f29.00000000000007a1 [read 1703936~16384] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+16384 (886875127 0 2903550480) 0x7f6e6803a530 con 0x7f6e5c015e80
  1057. 2017-10-03 11:09:58.724844 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1058. 2017-10-03 11:09:58.725215 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:91 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2359296~131072] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1059. 2017-10-03 11:09:58.725794 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1).handle_write
  1060. 2017-10-03 11:09:58.725941 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1061. 2017-10-03 11:09:58.725977 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1062. 2017-10-03 11:09:58.727380 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1063. 2017-10-03 11:09:58.727671 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 33 0x7f6e68066010 osd_op_reply(88 rbd_data.14481e238e1f29.00000000000007a1 [read 1724416~24576] v0'0 uv24009468 ondisk = 0) v8
  1064. 2017-10-03 11:09:58.727745 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 33 ==== osd_op_reply(88 rbd_data.14481e238e1f29.00000000000007a1 [read 1724416~24576] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+24576 (3921622943 0 3056859589) 0x7f6e68066010 con 0x7f6e5c015e80
  1065. 2017-10-03 11:09:58.727807 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 24760 to dispatch throttler 24760/104857600
  1066. 2017-10-03 11:09:58.727952 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1067. 2017-10-03 11:09:58.728026 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 34 0x7f6e680668d0 osd_op_reply(89 rbd_data.14481e238e1f29.00000000000007a1 [read 1753088~40960] v0'0 uv24009468 ondisk = 0) v8
  1068. 2017-10-03 11:09:58.728052 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 34 ==== osd_op_reply(89 rbd_data.14481e238e1f29.00000000000007a1 [read 1753088~40960] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+40960 (1199321844 0 1948719501) 0x7f6e680668d0 con 0x7f6e5c015e80
  1069. 2017-10-03 11:09:58.728090 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 41144 to dispatch throttler 41144/104857600
  1070. 2017-10-03 11:09:58.728343 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1071. 2017-10-03 11:09:58.728414 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 35 0x7f6e68069010 osd_op_reply(90 rbd_data.14481e238e1f29.00000000000007a1 [read 1798144~36864] v0'0 uv24009468 ondisk = 0) v8
  1072. 2017-10-03 11:09:58.728439 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 35 ==== osd_op_reply(90 rbd_data.14481e238e1f29.00000000000007a1 [read 1798144~36864] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+36864 (690196181 0 1184129612) 0x7f6e68069010 con 0x7f6e5c015e80
  1073. 2017-10-03 11:09:58.728479 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 37048 to dispatch throttler 37048/104857600
  1074. 2017-10-03 11:09:58.728772 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1075. 2017-10-03 11:09:58.728870 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 36 0x7f6e680696f0 osd_op_reply(91 rbd_data.14481e238e1f29.00000000000007a1 [read 2359296~131072] v0'0 uv24009468 ondisk = 0) v8
  1076. 2017-10-03 11:09:58.728901 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 36 ==== osd_op_reply(91 rbd_data.14481e238e1f29.00000000000007a1 [read 2359296~131072] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+131072 (1934253605 0 2916213246) 0x7f6e680696f0 con 0x7f6e5c015e80
  1077. 2017-10-03 11:09:58.728939 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 131256 to dispatch throttler 131256/104857600
  1078. 2017-10-03 11:09:58.728965 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:92 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1835008~57344] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  1079. 2017-10-03 11:09:58.729037 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1080. 2017-10-03 11:09:58.729105 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:93 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1896448~65536] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1081. 2017-10-03 11:09:58.729182 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1082. 2017-10-03 11:09:58.729226 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  1083. 2017-10-03 11:09:58.729313 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1084. 2017-10-03 11:09:58.729352 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1085. 2017-10-03 11:09:58.729377 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1086. 2017-10-03 11:09:58.729635 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:94 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2490368~131072] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c0280e0 con 0
  1087. 2017-10-03 11:09:58.729699 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1088. 2017-10-03 11:09:58.729806 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1089. 2017-10-03 11:09:58.729841 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0280e0 done.
  1090. 2017-10-03 11:09:58.730824 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1091. 2017-10-03 11:09:58.730928 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 37 0x7f6e680449e0 osd_op_reply(92 rbd_data.14481e238e1f29.00000000000007a1 [read 1835008~57344] v0'0 uv24009468 ondisk = 0) v8
  1092. 2017-10-03 11:09:58.730958 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 37 ==== osd_op_reply(92 rbd_data.14481e238e1f29.00000000000007a1 [read 1835008~57344] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+57344 (2913529465 0 139514774) 0x7f6e680449e0 con 0x7f6e5c015e80
  1093. 2017-10-03 11:09:58.731119 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 57528 to dispatch throttler 57528/104857600
  1094. 2017-10-03 11:09:58.731467 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1095. 2017-10-03 11:09:58.731558 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 38 0x7f6e6805f3b0 osd_op_reply(93 rbd_data.14481e238e1f29.00000000000007a1 [read 1896448~65536] v0'0 uv24009468 ondisk = 0) v8
  1096. 2017-10-03 11:09:58.731585 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 38 ==== osd_op_reply(93 rbd_data.14481e238e1f29.00000000000007a1 [read 1896448~65536] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+65536 (891996984 0 53599121) 0x7f6e6805f3b0 con 0x7f6e5c015e80
  1097. 2017-10-03 11:09:58.731628 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 65720 to dispatch throttler 65720/104857600
  1098. 2017-10-03 11:09:58.732126 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:95 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 1970176~61440] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1099. 2017-10-03 11:09:58.732195 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1).handle_write
  1100. 2017-10-03 11:09:58.732226 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:96 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2035712~28672] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1101. 2017-10-03 11:09:58.732327 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:97 3.39 3:9c2de3db:::rbd_data.14481e238e1f29.00000000000007a1:head [read 2068480~20480] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a960 con 0
  1102. 2017-10-03 11:09:58.732636 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1103. 2017-10-03 11:09:58.732706 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1104. 2017-10-03 11:09:58.732857 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1105. 2017-10-03 11:09:58.732878 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1106. 2017-10-03 11:09:58.732944 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1107. 2017-10-03 11:09:58.732977 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_DATA pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02a960 done.
  1108. 2017-10-03 11:09:58.733111 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1109. 2017-10-03 11:09:58.733191 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 39 0x7f6e68080460 osd_op_reply(94 rbd_data.14481e238e1f29.00000000000007a1 [read 2490368~131072] v0'0 uv24009468 ondisk = 0) v8
  1110. 2017-10-03 11:09:58.733217 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 39 ==== osd_op_reply(94 rbd_data.14481e238e1f29.00000000000007a1 [read 2490368~131072] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+131072 (987029149 0 1026260536) 0x7f6e68080460 con 0x7f6e5c015e80
  1111. 2017-10-03 11:09:58.733267 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 131256 to dispatch throttler 131256/104857600
  1112. 2017-10-03 11:09:58.733288 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1113. 2017-10-03 11:09:58.733406 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1114. 2017-10-03 11:09:58.733889 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:98 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1115. 2017-10-03 11:09:58.733953 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1116. 2017-10-03 11:09:58.734003 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:99 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1593344~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1117. 2017-10-03 11:09:58.734071 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1118. 2017-10-03 11:09:58.734070 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:100 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1601536~8192] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02b740 con 0
  1119. 2017-10-03 11:09:58.734091 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1120. 2017-10-03 11:09:58.734123 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1121. 2017-10-03 11:09:58.734128 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1122. 2017-10-03 11:09:58.734157 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:101 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1613824~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1123. 2017-10-03 11:09:58.734171 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1124. 2017-10-03 11:09:58.734178 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02b740 done.
  1125. 2017-10-03 11:09:58.734189 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1126. 2017-10-03 11:09:58.734201 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1127. 2017-10-03 11:09:58.734208 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1128. 2017-10-03 11:09:58.734220 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1129. 2017-10-03 11:09:58.734225 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1130. 2017-10-03 11:09:58.734229 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1131. 2017-10-03 11:09:58.734220 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:102 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1634304~69632] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1132. 2017-10-03 11:09:58.734247 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1133. 2017-10-03 11:09:58.734294 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1134. 2017-10-03 11:09:58.734306 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1135. 2017-10-03 11:09:58.734295 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 40 0x7f6e6809f010 osd_op_reply(95 rbd_data.14481e238e1f29.00000000000007a1 [read 1970176~61440] v0'0 uv24009468 ondisk = 0) v8
  1136. 2017-10-03 11:09:58.734338 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 40 ==== osd_op_reply(95 rbd_data.14481e238e1f29.00000000000007a1 [read 1970176~61440] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+61440 (792688479 0 1596817196) 0x7f6e6809f010 con 0x7f6e5c015e80
  1137. 2017-10-03 11:09:58.734370 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 61624 to dispatch throttler 61624/104857600
  1138. 2017-10-03 11:09:58.734473 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1139. 2017-10-03 11:09:58.734526 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 41 0x7f6e6809f6b0 osd_op_reply(96 rbd_data.14481e238e1f29.00000000000007a1 [read 2035712~28672] v0'0 uv24009468 ondisk = 0) v8
  1140. 2017-10-03 11:09:58.734543 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 41 ==== osd_op_reply(96 rbd_data.14481e238e1f29.00000000000007a1 [read 2035712~28672] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+28672 (1572236795 0 1330790202) 0x7f6e6809f6b0 con 0x7f6e5c015e80
  1141. 2017-10-03 11:09:58.734570 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 28856 to dispatch throttler 28856/104857600
  1142. 2017-10-03 11:09:58.734620 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1143. 2017-10-03 11:09:58.734655 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 42 0x7f6e6809f6b0 osd_op_reply(97 rbd_data.14481e238e1f29.00000000000007a1 [read 2068480~20480] v0'0 uv24009468 ondisk = 0) v8
  1144. 2017-10-03 11:09:58.734670 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 42 ==== osd_op_reply(97 rbd_data.14481e238e1f29.00000000000007a1 [read 2068480~20480] v0'0 uv24009468 ondisk = 0) v8 ==== 184+0+20480 (1514167147 0 883998264) 0x7f6e6809f6b0 con 0x7f6e5c015e80
  1145. 2017-10-03 11:09:58.734725 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 20664 to dispatch throttler 20664/104857600
  1146. 2017-10-03 11:09:58.734923 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:103 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1147. 2017-10-03 11:09:58.734962 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1148. 2017-10-03 11:09:58.735054 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1149. 2017-10-03 11:09:58.735066 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1150. 2017-10-03 11:09:58.735411 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1151. 2017-10-03 11:09:58.735537 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 18 0x7f6e7403bad0 osd_op_reply(98 rbd_data.14481e238e1f29.00000000000007ff [read 1572864~16384] v0'0 uv22140457 ondisk = 0) v8
  1152. 2017-10-03 11:09:58.735559 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 18 ==== osd_op_reply(98 rbd_data.14481e238e1f29.00000000000007ff [read 1572864~16384] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+16384 (3257685525 0 3539011591) 0x7f6e7403bad0 con 0x7f6e5c00f790
  1153. 2017-10-03 11:09:58.735635 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1154. 2017-10-03 11:09:58.735735 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1155. 2017-10-03 11:09:58.735848 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1).process aborted = 0
  1156. 2017-10-03 11:09:58.735887 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 19 0x7f6e7403d3b0 osd_op_reply(99 rbd_data.14481e238e1f29.00000000000007ff [read 1593344~4096] v0'0 uv22140457 ondisk = 0) v8
  1157. 2017-10-03 11:09:58.735904 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6324 cs=1 l=1). rx osd.0 seq 43 0x7f6e680a47f0 osd_op_reply(103 rbd_data.14481e238e1f29.000000000000003e [read 0~4096] v0'0 uv12608226 ondisk = 0) v8
  1158. 2017-10-03 11:09:58.735909 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 19 ==== osd_op_reply(99 rbd_data.14481e238e1f29.00000000000007ff [read 1593344~4096] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+4096 (724939488 0 3791200762) 0x7f6e7403d3b0 con 0x7f6e5c00f790
  1159. 2017-10-03 11:09:58.735923 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.0 10.10.252.9:6800/28044 43 ==== osd_op_reply(103 rbd_data.14481e238e1f29.000000000000003e [read 0~4096] v0'0 uv12608226 ondisk = 0) v8 ==== 184+0+4096 (3652771110 0 3671447868) 0x7f6e680a47f0 con 0x7f6e5c015e80
  1160. 2017-10-03 11:09:58.735945 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 8560/104857600
  1161. 2017-10-03 11:09:58.735954 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 12656/104857600
  1162. 2017-10-03 11:09:58.735983 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1163. 2017-10-03 11:09:58.736017 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 20 0x7f6e7403da90 osd_op_reply(100 rbd_data.14481e238e1f29.00000000000007ff [read 1601536~8192] v0'0 uv22140457 ondisk = 0) v8
  1164. 2017-10-03 11:09:58.736138 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 20 ==== osd_op_reply(100 rbd_data.14481e238e1f29.00000000000007ff [read 1601536~8192] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+8192 (2986556530 0 2109238805) 0x7f6e7403da90 con 0x7f6e5c00f790
  1165. 2017-10-03 11:09:58.736335 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 8376 to dispatch throttler 8376/104857600
  1166. 2017-10-03 11:09:58.736531 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1167. 2017-10-03 11:09:58.736595 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 21 0x7f6e740441d0 osd_op_reply(101 rbd_data.14481e238e1f29.00000000000007ff [read 1613824~16384] v0'0 uv22140457 ondisk = 0) v8
  1168. 2017-10-03 11:09:58.736611 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 21 ==== osd_op_reply(101 rbd_data.14481e238e1f29.00000000000007ff [read 1613824~16384] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+16384 (1445209416 0 1091042773) 0x7f6e740441d0 con 0x7f6e5c00f790
  1169. 2017-10-03 11:09:58.736639 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1170. 2017-10-03 11:09:58.736768 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1171. 2017-10-03 11:09:58.736819 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 22 0x7f6e740448b0 osd_op_reply(102 rbd_data.14481e238e1f29.00000000000007ff [read 1634304~69632] v0'0 uv22140457 ondisk = 0) v8
  1172. 2017-10-03 11:09:58.736833 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 22 ==== osd_op_reply(102 rbd_data.14481e238e1f29.00000000000007ff [read 1634304~69632] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+69632 (330396749 0 2923980552) 0x7f6e740448b0 con 0x7f6e5c00f790
  1173. 2017-10-03 11:09:58.736866 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 69816 to dispatch throttler 69816/104857600
  1174. 2017-10-03 11:09:58.737239 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:104 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1175. 2017-10-03 11:09:58.737301 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1176. 2017-10-03 11:09:58.737338 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:105 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1724416~24576] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1177. 2017-10-03 11:09:58.737401 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:106 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1753088~40960] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1178. 2017-10-03 11:09:58.737419 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1179. 2017-10-03 11:09:58.737435 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1180. 2017-10-03 11:09:58.737468 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:107 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1798144~36864] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1181. 2017-10-03 11:09:58.737478 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1182. 2017-10-03 11:09:58.737487 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1183. 2017-10-03 11:09:58.737517 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1184. 2017-10-03 11:09:58.737525 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1185. 2017-10-03 11:09:58.737567 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1186. 2017-10-03 11:09:58.737577 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1187. 2017-10-03 11:09:58.737594 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1188. 2017-10-03 11:09:58.737601 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1189. 2017-10-03 11:09:58.737607 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1190. 2017-10-03 11:09:58.739097 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1191. 2017-10-03 11:09:58.739133 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 23 0x7f6e7404c010 osd_op_reply(104 rbd_data.14481e238e1f29.00000000000007ff [read 1703936~16384] v0'0 uv22140457 ondisk = 0) v8
  1192. 2017-10-03 11:09:58.739142 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 23 ==== osd_op_reply(104 rbd_data.14481e238e1f29.00000000000007ff [read 1703936~16384] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+16384 (2343753389 0 2620383389) 0x7f6e7404c010 con 0x7f6e5c00f790
  1193. 2017-10-03 11:09:58.739162 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1194. 2017-10-03 11:09:58.739536 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1195. 2017-10-03 11:09:58.739622 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 24 0x7f6e7404c8d0 osd_op_reply(105 rbd_data.14481e238e1f29.00000000000007ff [read 1724416~24576] v0'0 uv22140457 ondisk = 0) v8
  1196. 2017-10-03 11:09:58.739637 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 24 ==== osd_op_reply(105 rbd_data.14481e238e1f29.00000000000007ff [read 1724416~24576] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+24576 (1456554693 0 67007832) 0x7f6e7404c8d0 con 0x7f6e5c00f790
  1197. 2017-10-03 11:09:58.739662 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 24760 to dispatch throttler 24760/104857600
  1198. 2017-10-03 11:09:58.740230 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1199. 2017-10-03 11:09:58.740353 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 25 0x7f6e7405e010 osd_op_reply(106 rbd_data.14481e238e1f29.00000000000007ff [read 1753088~40960] v0'0 uv22140457 ondisk = 0) v8
  1200. 2017-10-03 11:09:58.740368 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 25 ==== osd_op_reply(106 rbd_data.14481e238e1f29.00000000000007ff [read 1753088~40960] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+40960 (4161947566 0 2195548981) 0x7f6e7405e010 con 0x7f6e5c00f790
  1201. 2017-10-03 11:09:58.740393 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 41144 to dispatch throttler 41144/104857600
  1202. 2017-10-03 11:09:58.740608 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1203. 2017-10-03 11:09:58.740653 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 26 0x7f6e7405e6f0 osd_op_reply(107 rbd_data.14481e238e1f29.00000000000007ff [read 1798144~36864] v0'0 uv22140457 ondisk = 0) v8
  1204. 2017-10-03 11:09:58.740665 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 26 ==== osd_op_reply(107 rbd_data.14481e238e1f29.00000000000007ff [read 1798144~36864] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+36864 (2521693071 0 2706447709) 0x7f6e7405e6f0 con 0x7f6e5c00f790
  1205. 2017-10-03 11:09:58.740686 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 37048 to dispatch throttler 37048/104857600
  1206. 2017-10-03 11:09:58.740959 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:108 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1835008~57344] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1207. 2017-10-03 11:09:58.741026 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:109 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1896448~65536] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1208. 2017-10-03 11:09:58.741031 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1209. 2017-10-03 11:09:58.741100 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1210. 2017-10-03 11:09:58.741109 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1211. 2017-10-03 11:09:58.741150 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1212. 2017-10-03 11:09:58.741156 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1213. 2017-10-03 11:09:58.741166 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1214. 2017-10-03 11:09:58.742424 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1215. 2017-10-03 11:09:58.742547 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 27 0x7f6e740425b0 osd_op_reply(108 rbd_data.14481e238e1f29.00000000000007ff [read 1835008~57344] v0'0 uv22140457 ondisk = 0) v8
  1216. 2017-10-03 11:09:58.742588 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 27 ==== osd_op_reply(108 rbd_data.14481e238e1f29.00000000000007ff [read 1835008~57344] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+57344 (315005731 0 2777445767) 0x7f6e740425b0 con 0x7f6e5c00f790
  1217. 2017-10-03 11:09:58.742627 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 57528 to dispatch throttler 57528/104857600
  1218. 2017-10-03 11:09:58.743102 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1219. 2017-10-03 11:09:58.743149 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 28 0x7f6e740425b0 osd_op_reply(109 rbd_data.14481e238e1f29.00000000000007ff [read 1896448~65536] v0'0 uv22140457 ondisk = 0) v8
  1220. 2017-10-03 11:09:58.743162 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 28 ==== osd_op_reply(109 rbd_data.14481e238e1f29.00000000000007ff [read 1896448~65536] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+65536 (2319760994 0 777356739) 0x7f6e740425b0 con 0x7f6e5c00f790
  1221. 2017-10-03 11:09:58.743188 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 65720 to dispatch throttler 65720/104857600
  1222. 2017-10-03 11:09:58.743450 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:110 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 1970176~61440] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1223. 2017-10-03 11:09:58.743484 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1224. 2017-10-03 11:09:58.743503 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:111 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 2035712~28672] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1225. 2017-10-03 11:09:58.743535 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:112 3.ec 3:37624ba1:::rbd_data.14481e238e1f29.00000000000007ff:head [read 2068480~20480] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02c5b0 con 0
  1226. 2017-10-03 11:09:58.743566 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1227. 2017-10-03 11:09:58.743580 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1228. 2017-10-03 11:09:58.743627 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1229. 2017-10-03 11:09:58.743634 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1230. 2017-10-03 11:09:58.743670 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1231. 2017-10-03 11:09:58.743688 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02c5b0 done.
  1232. 2017-10-03 11:09:58.743702 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1233. 2017-10-03 11:09:58.743708 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1234. 2017-10-03 11:09:58.744665 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1235. 2017-10-03 11:09:58.744796 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 29 0x7f6e74075010 osd_op_reply(110 rbd_data.14481e238e1f29.00000000000007ff [read 1970176~61440] v0'0 uv22140457 ondisk = 0) v8
  1236. 2017-10-03 11:09:58.744812 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 29 ==== osd_op_reply(110 rbd_data.14481e238e1f29.00000000000007ff [read 1970176~61440] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+61440 (2421228037 0 2218188778) 0x7f6e74075010 con 0x7f6e5c00f790
  1237. 2017-10-03 11:09:58.744882 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 61624 to dispatch throttler 61624/104857600
  1238. 2017-10-03 11:09:58.745039 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1239. 2017-10-03 11:09:58.745130 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 30 0x7f6e740758d0 osd_op_reply(111 rbd_data.14481e238e1f29.00000000000007ff [read 2035712~28672] v0'0 uv22140457 ondisk = 0) v8
  1240. 2017-10-03 11:09:58.745142 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 30 ==== osd_op_reply(111 rbd_data.14481e238e1f29.00000000000007ff [read 2035712~28672] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+28672 (3805812897 0 1177427385) 0x7f6e740758d0 con 0x7f6e5c00f790
  1241. 2017-10-03 11:09:58.745181 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 28856 to dispatch throttler 28856/104857600
  1242. 2017-10-03 11:09:58.745218 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  1243. 2017-10-03 11:09:58.745244 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 31 0x7f6e7407f010 osd_op_reply(112 rbd_data.14481e238e1f29.00000000000007ff [read 2068480~20480] v0'0 uv22140457 ondisk = 0) v8
  1244. 2017-10-03 11:09:58.745253 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 31 ==== osd_op_reply(112 rbd_data.14481e238e1f29.00000000000007ff [read 2068480~20480] v0'0 uv22140457 ondisk = 0) v8 ==== 184+0+20480 (3845008945 0 223705674) 0x7f6e7407f010 con 0x7f6e5c00f790
  1245. 2017-10-03 11:09:58.745272 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 20664 to dispatch throttler 20664/104857600
  1246. 2017-10-03 11:09:58.745448 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:113 3.46 3:626730ba:::rbd_data.14481e238e1f29.00000000000007a2:head [read 0~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02af80 con 0
  1247. 2017-10-03 11:09:58.745479 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1248. 2017-10-03 11:09:58.745582 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1249. 2017-10-03 11:09:58.745588 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c02af80 done.
  1250. 2017-10-03 11:09:58.746660 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1251. 2017-10-03 11:09:58.746746 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 18 0x7f6e7003e5d0 osd_op_reply(113 rbd_data.14481e238e1f29.00000000000007a2 [read 0~4096] v0'0 uv21653081 ondisk = 0) v8
  1252. 2017-10-03 11:09:58.746766 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 18 ==== osd_op_reply(113 rbd_data.14481e238e1f29.00000000000007a2 [read 0~4096] v0'0 uv21653081 ondisk = 0) v8 ==== 184+0+4096 (1652154770 0 2200271091) 0x7f6e7003e5d0 con 0x7f6e5c008a70
  1253. 2017-10-03 11:09:58.746796 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1254.  
  1255.  
  1256.  
  1257.  
  1258.  
  1259.  
  1260.  
  1261.  
  1262.  
  1263.  
  1264.  
  1265.  
  1266. 2017-10-03 11:10:03.710291 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:114 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158049) v8 -- 0x7f6e50000e40 con 0
  1267. 2017-10-03 11:10:03.710373 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50002600 con 0
  1268. 2017-10-03 11:10:03.710423 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1269. 2017-10-03 11:10:03.710538 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  1270. 2017-10-03 11:10:03.710559 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50002600 done.
  1271. 2017-10-03 11:10:03.710654 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  1272. 2017-10-03 11:10:03.710669 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  1273. 2017-10-03 11:10:03.710678 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1274. 2017-10-03 11:10:03.711801 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1275. 2017-10-03 11:10:03.711875 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 17 0x7f6e7407fc50 osd_op_reply(114 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005940 ondisk = 0) v8
  1276. 2017-10-03 11:10:03.711896 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 17 ==== osd_op_reply(114 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+0 (2146651683 0 0) 0x7f6e7407fc50 con 0x7f6e600050d0
  1277. 2017-10-03 11:10:03.711926 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  1278.  
  1279.  
  1280.  
  1281.  
  1282.  
  1283.  
  1284.  
  1285.  
  1286.  
  1287.  
  1288.  
  1289.  
  1290.  
  1291. 2017-10-03 11:10:06.227383 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:115 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [read 4169728~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1292. 2017-10-03 11:10:06.227527 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1293. 2017-10-03 11:10:06.227773 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1294. 2017-10-03 11:10:06.227796 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1295. 2017-10-03 11:10:06.229240 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1296. 2017-10-03 11:10:06.229313 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 19 0x7f6e7007e1b0 osd_op_reply(115 rbd_data.14481e238e1f29.000000000000003d [read 4169728~4096] v0'0 uv25292674 ondisk = 0) v8
  1297. 2017-10-03 11:10:06.229334 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 19 ==== osd_op_reply(115 rbd_data.14481e238e1f29.000000000000003d [read 4169728~4096] v0'0 uv25292674 ondisk = 0) v8 ==== 184+0+4096 (669210706 0 502305983) 0x7f6e7007e1b0 con 0x7f6e5c008a70
  1298. 2017-10-03 11:10:06.229378 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1299. 2017-10-03 11:10:06.230541 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:116 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2097152~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02a450 con 0
  1300. 2017-10-03 11:10:06.230653 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1301. 2017-10-03 11:10:06.230799 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1302. 2017-10-03 11:10:06.230816 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02a450 done.
  1303. 2017-10-03 11:10:06.231828 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1304. 2017-10-03 11:10:06.231911 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 3 0x7f6e7009f010 osd_op_reply(116 rbd_data.14481e238e1f29.000000000000025d [read 2097152~4096] v0'0 uv41983707 ondisk = 0) v8
  1305. 2017-10-03 11:10:06.231930 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 3 ==== osd_op_reply(116 rbd_data.14481e238e1f29.000000000000025d [read 2097152~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (51273090 0 1520243644) 0x7f6e7009f010 con 0x56221c9ef7a0
  1306. 2017-10-03 11:10:06.231978 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1307. 2017-10-03 11:10:06.233234 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:117 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2101248~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1308. 2017-10-03 11:10:06.233359 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1309. 2017-10-03 11:10:06.233570 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1310. 2017-10-03 11:10:06.233592 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1311. 2017-10-03 11:10:06.234697 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1312. 2017-10-03 11:10:06.234788 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 4 0x7f6e7009f9f0 osd_op_reply(117 rbd_data.14481e238e1f29.000000000000025d [read 2101248~16384] v0'0 uv41983707 ondisk = 0) v8
  1313. 2017-10-03 11:10:06.234814 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 4 ==== osd_op_reply(117 rbd_data.14481e238e1f29.000000000000025d [read 2101248~16384] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+16384 (3810814304 0 2170030105) 0x7f6e7009f9f0 con 0x56221c9ef7a0
  1314. 2017-10-03 11:10:06.234858 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1315. 2017-10-03 11:10:06.235323 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:118 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2117632~32768] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1316. 2017-10-03 11:10:06.235391 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1317. 2017-10-03 11:10:06.235444 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:119 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2297856~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02b740 con 0
  1318. 2017-10-03 11:10:06.235512 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1319. 2017-10-03 11:10:06.235529 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1320. 2017-10-03 11:10:06.235579 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1321. 2017-10-03 11:10:06.235595 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02b740 done.
  1322. 2017-10-03 11:10:06.235613 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1323. 2017-10-03 11:10:06.236584 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1324. 2017-10-03 11:10:06.236668 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 5 0x7f6e700a1970 osd_op_reply(118 rbd_data.14481e238e1f29.000000000000025d [read 2117632~32768] v0'0 uv41983707 ondisk = 0) v8
  1325. 2017-10-03 11:10:06.236693 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 5 ==== osd_op_reply(118 rbd_data.14481e238e1f29.000000000000025d [read 2117632~32768] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+32768 (2540883699 0 134541701) 0x7f6e700a1970 con 0x56221c9ef7a0
  1326. 2017-10-03 11:10:06.236733 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 32952 to dispatch throttler 32952/104857600
  1327. 2017-10-03 11:10:06.236779 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1328. 2017-10-03 11:10:06.236834 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 6 0x7f6e700a1970 osd_op_reply(119 rbd_data.14481e238e1f29.000000000000025d [read 2297856~4096] v0'0 uv41983707 ondisk = 0) v8
  1329. 2017-10-03 11:10:06.236856 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 6 ==== osd_op_reply(119 rbd_data.14481e238e1f29.000000000000025d [read 2297856~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (2946387879 0 832929305) 0x7f6e700a1970 con 0x56221c9ef7a0
  1330. 2017-10-03 11:10:06.236893 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1331. 2017-10-03 11:10:06.237180 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:120 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2301952~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1332. 2017-10-03 11:10:06.237266 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1333. 2017-10-03 11:10:06.237421 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1334. 2017-10-03 11:10:06.237448 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1335. 2017-10-03 11:10:06.238231 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1336. 2017-10-03 11:10:06.238297 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 7 0x7f6e700a5b90 osd_op_reply(120 rbd_data.14481e238e1f29.000000000000025d [read 2301952~16384] v0'0 uv41983707 ondisk = 0) v8
  1337. 2017-10-03 11:10:06.238322 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 7 ==== osd_op_reply(120 rbd_data.14481e238e1f29.000000000000025d [read 2301952~16384] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+16384 (3386615862 0 2269697554) 0x7f6e700a5b90 con 0x56221c9ef7a0
  1338. 2017-10-03 11:10:06.238361 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1339. 2017-10-03 11:10:06.238679 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:121 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2318336~32768] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028d80 con 0
  1340. 2017-10-03 11:10:06.238746 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1341. 2017-10-03 11:10:06.238815 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:122 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2351104~131072] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02ccf0 con 0
  1342. 2017-10-03 11:10:06.238875 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1343. 2017-10-03 11:10:06.238895 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c028d80 done.
  1344. 2017-10-03 11:10:06.238891 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:123 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2482176~65536] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02d030 con 0
  1345. 2017-10-03 11:10:06.238979 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1346. 2017-10-03 11:10:06.238991 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02ccf0 done.
  1347. 2017-10-03 11:10:06.239033 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1348. 2017-10-03 11:10:06.239044 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02d030 done.
  1349. 2017-10-03 11:10:06.239060 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1350. 2017-10-03 11:10:06.239069 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1351. 2017-10-03 11:10:06.240352 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1352. 2017-10-03 11:10:06.240438 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 8 0x7f6e700aa010 osd_op_reply(121 rbd_data.14481e238e1f29.000000000000025d [read 2318336~32768] v0'0 uv41983707 ondisk = 0) v8
  1353. 2017-10-03 11:10:06.240468 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 8 ==== osd_op_reply(121 rbd_data.14481e238e1f29.000000000000025d [read 2318336~32768] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+32768 (3180138405 0 1573701265) 0x7f6e700aa010 con 0x56221c9ef7a0
  1354. 2017-10-03 11:10:06.240516 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 32952 to dispatch throttler 32952/104857600
  1355. 2017-10-03 11:10:06.242160 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1356. 2017-10-03 11:10:06.242498 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 9 0x7f6e700aa8d0 osd_op_reply(122 rbd_data.14481e238e1f29.000000000000025d [read 2351104~131072] v0'0 uv41983707 ondisk = 0) v8
  1357. 2017-10-03 11:10:06.242581 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 9 ==== osd_op_reply(122 rbd_data.14481e238e1f29.000000000000025d [read 2351104~131072] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+131072 (2774132834 0 2740385278) 0x7f6e700aa8d0 con 0x56221c9ef7a0
  1358. 2017-10-03 11:10:06.242632 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 131256 to dispatch throttler 131256/104857600
  1359. 2017-10-03 11:10:06.242815 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1360. 2017-10-03 11:10:06.242903 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 10 0x7f6e700b3010 osd_op_reply(123 rbd_data.14481e238e1f29.000000000000025d [read 2482176~65536] v0'0 uv41983707 ondisk = 0) v8
  1361. 2017-10-03 11:10:06.242927 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 10 ==== osd_op_reply(123 rbd_data.14481e238e1f29.000000000000025d [read 2482176~65536] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+65536 (2407776587 0 3288255176) 0x7f6e700b3010 con 0x56221c9ef7a0
  1362. 2017-10-03 11:10:06.242962 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 65720 to dispatch throttler 65720/104857600
  1363. 2017-10-03 11:10:06.243381 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:124 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2633728~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c026830 con 0
  1364. 2017-10-03 11:10:06.243460 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1365. 2017-10-03 11:10:06.243600 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1366. 2017-10-03 11:10:06.243625 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c026830 done.
  1367. 2017-10-03 11:10:06.244244 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1368. 2017-10-03 11:10:06.244341 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 11 0x7f6e700b39f0 osd_op_reply(124 rbd_data.14481e238e1f29.000000000000025d [read 2633728~4096] v0'0 uv41983707 ondisk = 0) v8
  1369. 2017-10-03 11:10:06.244363 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 11 ==== osd_op_reply(124 rbd_data.14481e238e1f29.000000000000025d [read 2633728~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (1731602465 0 1382091603) 0x7f6e700b39f0 con 0x56221c9ef7a0
  1370. 2017-10-03 11:10:06.244401 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1371. 2017-10-03 11:10:06.244813 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:125 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2637824~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c026830 con 0
  1372. 2017-10-03 11:10:06.244881 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1373. 2017-10-03 11:10:06.245038 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1374. 2017-10-03 11:10:06.245055 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c026830 done.
  1375. 2017-10-03 11:10:06.245950 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1376. 2017-10-03 11:10:06.246063 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 12 0x7f6e700ba510 osd_op_reply(125 rbd_data.14481e238e1f29.000000000000025d [read 2637824~16384] v0'0 uv41983707 ondisk = 0) v8
  1377. 2017-10-03 11:10:06.246085 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 12 ==== osd_op_reply(125 rbd_data.14481e238e1f29.000000000000025d [read 2637824~16384] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+16384 (138420135 0 3792639049) 0x7f6e700ba510 con 0x56221c9ef7a0
  1378. 2017-10-03 11:10:06.246148 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1379. 2017-10-03 11:10:06.246604 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:126 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2662400~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c026830 con 0
  1380. 2017-10-03 11:10:06.246679 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1381. 2017-10-03 11:10:06.246828 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1382. 2017-10-03 11:10:06.246840 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c026830 done.
  1383. 2017-10-03 11:10:06.247545 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1384. 2017-10-03 11:10:06.247602 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 13 0x7f6e700c3010 osd_op_reply(126 rbd_data.14481e238e1f29.000000000000025d [read 2662400~4096] v0'0 uv41983707 ondisk = 0) v8
  1385. 2017-10-03 11:10:06.247618 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 13 ==== osd_op_reply(126 rbd_data.14481e238e1f29.000000000000025d [read 2662400~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (3029359310 0 2708717712) 0x7f6e700c3010 con 0x56221c9ef7a0
  1386. 2017-10-03 11:10:06.247652 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1387. 2017-10-03 11:10:06.248003 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:127 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2666496~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c026830 con 0
  1388. 2017-10-03 11:10:06.248068 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1389. 2017-10-03 11:10:06.248201 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1390. 2017-10-03 11:10:06.248215 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c026830 done.
  1391. 2017-10-03 11:10:06.249007 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1392. 2017-10-03 11:10:06.249059 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 14 0x7f6e700c3bd0 osd_op_reply(127 rbd_data.14481e238e1f29.000000000000025d [read 2666496~16384] v0'0 uv41983707 ondisk = 0) v8
  1393. 2017-10-03 11:10:06.249073 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 14 ==== osd_op_reply(127 rbd_data.14481e238e1f29.000000000000025d [read 2666496~16384] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+16384 (1421504044 0 1028291370) 0x7f6e700c3bd0 con 0x56221c9ef7a0
  1394. 2017-10-03 11:10:06.249106 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1395. 2017-10-03 11:10:06.249410 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:128 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2686976~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c026830 con 0
  1396. 2017-10-03 11:10:06.249464 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1397. 2017-10-03 11:10:06.249572 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1398. 2017-10-03 11:10:06.249583 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c026830 done.
  1399. 2017-10-03 11:10:06.250253 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1400. 2017-10-03 11:10:06.250319 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 15 0x7f6e700a36d0 osd_op_reply(128 rbd_data.14481e238e1f29.000000000000025d [read 2686976~4096] v0'0 uv41983707 ondisk = 0) v8
  1401. 2017-10-03 11:10:06.250341 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 15 ==== osd_op_reply(128 rbd_data.14481e238e1f29.000000000000025d [read 2686976~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (72837583 0 1660726881) 0x7f6e700a36d0 con 0x56221c9ef7a0
  1402. 2017-10-03 11:10:06.250382 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1403. 2017-10-03 11:10:06.250652 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:129 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2691072~16384] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c026830 con 0
  1404. 2017-10-03 11:10:06.250709 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1405. 2017-10-03 11:10:06.250844 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1406. 2017-10-03 11:10:06.250864 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c026830 done.
  1407. 2017-10-03 11:10:06.251489 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1408. 2017-10-03 11:10:06.251541 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 16 0x7f6e700e4310 osd_op_reply(129 rbd_data.14481e238e1f29.000000000000025d [read 2691072~16384] v0'0 uv41983707 ondisk = 0) v8
  1409. 2017-10-03 11:10:06.251555 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 16 ==== osd_op_reply(129 rbd_data.14481e238e1f29.000000000000025d [read 2691072~16384] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+16384 (3833421101 0 1809422855) 0x7f6e700e4310 con 0x56221c9ef7a0
  1410. 2017-10-03 11:10:06.251586 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 16568 to dispatch throttler 16568/104857600
  1411. 2017-10-03 11:10:06.252024 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:130 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2707456~98304] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028eb0 con 0
  1412. 2017-10-03 11:10:06.252072 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1413. 2017-10-03 11:10:06.252171 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1414. 2017-10-03 11:10:06.252183 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c028eb0 done.
  1415. 2017-10-03 11:10:06.253910 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1416. 2017-10-03 11:10:06.254002 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 17 0x7f6e700f5010 osd_op_reply(130 rbd_data.14481e238e1f29.000000000000025d [read 2707456~98304] v0'0 uv41983707 ondisk = 0) v8
  1417. 2017-10-03 11:10:06.254019 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 17 ==== osd_op_reply(130 rbd_data.14481e238e1f29.000000000000025d [read 2707456~98304] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+98304 (1017597774 0 1903348903) 0x7f6e700f5010 con 0x56221c9ef7a0
  1418. 2017-10-03 11:10:06.254057 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 98488 to dispatch throttler 98488/104857600
  1419. 2017-10-03 11:10:06.254714 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:131 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2150400~73728] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c028eb0 con 0
  1420. 2017-10-03 11:10:06.254786 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1421. 2017-10-03 11:10:06.254827 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:132 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2224128~73728] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02ccf0 con 0
  1422. 2017-10-03 11:10:06.254925 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1423. 2017-10-03 11:10:06.254943 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c028eb0 done.
  1424. 2017-10-03 11:10:06.255004 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1425. 2017-10-03 11:10:06.255020 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02ccf0 done.
  1426. 2017-10-03 11:10:06.255042 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1427. 2017-10-03 11:10:06.256147 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1428. 2017-10-03 11:10:06.256229 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 18 0x7f6e700b5010 osd_op_reply(131 rbd_data.14481e238e1f29.000000000000025d [read 2150400~73728] v0'0 uv41983707 ondisk = 0) v8
  1429. 2017-10-03 11:10:06.256253 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 18 ==== osd_op_reply(131 rbd_data.14481e238e1f29.000000000000025d [read 2150400~73728] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+73728 (1783502699 0 1795670700) 0x7f6e700b5010 con 0x56221c9ef7a0
  1430. 2017-10-03 11:10:06.256327 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 73912 to dispatch throttler 73912/104857600
  1431. 2017-10-03 11:10:06.256807 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1432. 2017-10-03 11:10:06.256869 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 19 0x7f6e700b56f0 osd_op_reply(132 rbd_data.14481e238e1f29.000000000000025d [read 2224128~73728] v0'0 uv41983707 ondisk = 0) v8
  1433. 2017-10-03 11:10:06.256883 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 19 ==== osd_op_reply(132 rbd_data.14481e238e1f29.000000000000025d [read 2224128~73728] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+73728 (3371074628 0 577733215) 0x7f6e700b56f0 con 0x56221c9ef7a0
  1434. 2017-10-03 11:10:06.256912 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 73912 to dispatch throttler 73912/104857600
  1435. 2017-10-03 11:10:06.257707 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:133 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2547712~86016] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02ccf0 con 0
  1436. 2017-10-03 11:10:06.257769 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1437. 2017-10-03 11:10:06.257811 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:134 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2654208~8192] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02d1e0 con 0
  1438. 2017-10-03 11:10:06.257868 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1439. 2017-10-03 11:10:06.257884 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02ccf0 done.
  1440. 2017-10-03 11:10:06.257879 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:135 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2682880~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02d990 con 0
  1441. 2017-10-03 11:10:06.257941 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1442. 2017-10-03 11:10:06.257951 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02d1e0 done.
  1443. 2017-10-03 11:10:06.257950 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:136 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2805760~4096] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02e150 con 0
  1444. 2017-10-03 11:10:06.257999 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1445. 2017-10-03 11:10:06.258009 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02d990 done.
  1446. 2017-10-03 11:10:06.258054 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1447. 2017-10-03 11:10:06.258066 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02e150 done.
  1448. 2017-10-03 11:10:06.258086 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1449. 2017-10-03 11:10:06.258092 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1450. 2017-10-03 11:10:06.258097 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1451. 2017-10-03 11:10:06.259179 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1452. 2017-10-03 11:10:06.259282 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 20 0x7f6e700fc010 osd_op_reply(133 rbd_data.14481e238e1f29.000000000000025d [read 2547712~86016] v0'0 uv41983707 ondisk = 0) v8
  1453. 2017-10-03 11:10:06.259309 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 20 ==== osd_op_reply(133 rbd_data.14481e238e1f29.000000000000025d [read 2547712~86016] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+86016 (3275351948 0 3680451797) 0x7f6e700fc010 con 0x56221c9ef7a0
  1454. 2017-10-03 11:10:06.259357 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 86200 to dispatch throttler 86200/104857600
  1455. 2017-10-03 11:10:06.259400 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1456. 2017-10-03 11:10:06.259433 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 21 0x7f6e700fc6f0 osd_op_reply(134 rbd_data.14481e238e1f29.000000000000025d [read 2654208~8192] v0'0 uv41983707 ondisk = 0) v8
  1457. 2017-10-03 11:10:06.259445 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 21 ==== osd_op_reply(134 rbd_data.14481e238e1f29.000000000000025d [read 2654208~8192] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+8192 (765908060 0 1265381969) 0x7f6e700fc6f0 con 0x56221c9ef7a0
  1458. 2017-10-03 11:10:06.259469 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 8376 to dispatch throttler 8376/104857600
  1459. 2017-10-03 11:10:06.259501 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1460. 2017-10-03 11:10:06.259536 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 22 0x7f6e700fc6f0 osd_op_reply(135 rbd_data.14481e238e1f29.000000000000025d [read 2682880~4096] v0'0 uv41983707 ondisk = 0) v8
  1461. 2017-10-03 11:10:06.259547 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 22 ==== osd_op_reply(135 rbd_data.14481e238e1f29.000000000000025d [read 2682880~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (2086819864 0 2740604442) 0x7f6e700fc6f0 con 0x56221c9ef7a0
  1462. 2017-10-03 11:10:06.259570 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1463. 2017-10-03 11:10:06.259596 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1464. 2017-10-03 11:10:06.259628 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 23 0x7f6e700fe530 osd_op_reply(136 rbd_data.14481e238e1f29.000000000000025d [read 2805760~4096] v0'0 uv41983707 ondisk = 0) v8
  1465. 2017-10-03 11:10:06.259639 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 23 ==== osd_op_reply(136 rbd_data.14481e238e1f29.000000000000025d [read 2805760~4096] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+4096 (3012758483 0 799297741) 0x7f6e700fe530 con 0x56221c9ef7a0
  1466. 2017-10-03 11:10:06.259659 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 4280 to dispatch throttler 4280/104857600
  1467. 2017-10-03 11:10:06.260520 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:137 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [read 2809856~131072] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02de80 con 0
  1468. 2017-10-03 11:10:06.260609 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1469. 2017-10-03 11:10:06.260831 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 324 remaining bytes 0
  1470. 2017-10-03 11:10:06.260845 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c02de80 done.
  1471. 2017-10-03 11:10:06.260991 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:138 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call lock.get_info] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e5c02de80 con 0
  1472. 2017-10-03 11:10:06.261066 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1473. 2017-10-03 11:10:06.261152 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 339 remaining bytes 0
  1474. 2017-10-03 11:10:06.261160 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e5c02de80 done.
  1475. 2017-10-03 11:10:06.262533 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  1476. 2017-10-03 11:10:06.262613 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 24 0x7f6e70103010 osd_op_reply(137 rbd_data.14481e238e1f29.000000000000025d [read 2809856~131072] v0'0 uv41983707 ondisk = 0) v8
  1477. 2017-10-03 11:10:06.262628 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 24 ==== osd_op_reply(137 rbd_data.14481e238e1f29.000000000000025d [read 2809856~131072] v0'0 uv41983707 ondisk = 0) v8 ==== 184+0+131072 (2717965359 0 4237247277) 0x7f6e70103010 con 0x56221c9ef7a0
  1478. 2017-10-03 11:10:06.262661 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 131256 to dispatch throttler 131256/104857600
  1479. 2017-10-03 11:10:06.316218 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1480. 2017-10-03 11:10:06.316305 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 18 0x7f6e7408e790 osd_op_reply(138 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8
  1481. 2017-10-03 11:10:06.316327 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 18 ==== osd_op_reply(138 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+115 (932069256 0 2118929215) 0x7f6e7408e790 con 0x7f6e600050d0
  1482. 2017-10-03 11:10:06.316359 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 284 to dispatch throttler 284/104857600
  1483. 2017-10-03 11:10:06.316464 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:139 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call lock.lock] snapc 0=[] ondisk+write+known_if_redirected e158049) v8 -- 0x7f6e6007c760 con 0
  1484. 2017-10-03 11:10:06.316552 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1485. 2017-10-03 11:10:06.316669 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 385 remaining bytes 0
  1486. 2017-10-03 11:10:06.316685 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e6007c760 done.
  1487. 2017-10-03 11:10:06.319621 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1488. 2017-10-03 11:10:06.319720 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 19 0x7f6e740af2d0 osd_op_reply(139 rbd_header.14481e238e1f29 [call] v158049'22005969 uv22005940 ondisk = -16 ((16) Device or resource busy)) v8
  1489. 2017-10-03 11:10:06.319756 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 19 ==== osd_op_reply(139 rbd_header.14481e238e1f29 [call] v158049'22005969 uv22005940 ondisk = -16 ((16) Device or resource busy)) v8 ==== 169+0+0 (3954914558 0 0) 0x7f6e740af2d0 con 0x7f6e600050d0
  1490. 2017-10-03 11:10:06.319801 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  1491. 2017-10-03 11:10:06.319868 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:140 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [list-watchers] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60074670 con 0
  1492. 2017-10-03 11:10:06.319916 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1493. 2017-10-03 11:10:06.320015 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  1494. 2017-10-03 11:10:06.320029 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60074670 done.
  1495. 2017-10-03 11:10:06.320603 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1496. 2017-10-03 11:10:06.320653 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 20 0x7f6e74063010 osd_op_reply(140 rbd_header.14481e238e1f29 [list-watchers] v0'0 uv22005940 ondisk = 0) v8
  1497. 2017-10-03 11:10:06.320673 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 20 ==== osd_op_reply(140 rbd_header.14481e238e1f29 [list-watchers] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+72 (2544967757 0 4022838522) 0x7f6e74063010 con 0x7f6e600050d0
  1498. 2017-10-03 11:10:06.320749 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 241 to dispatch throttler 241/104857600
  1499. 2017-10-03 11:10:06.320804 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:141 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call lock.get_info] snapc 0=[] ondisk+read+known_if_redirected e158049) v8 -- 0x7f6e60074c80 con 0
  1500. 2017-10-03 11:10:06.320848 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1501. 2017-10-03 11:10:06.320926 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 339 remaining bytes 0
  1502. 2017-10-03 11:10:06.320937 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60074c80 done.
  1503. 2017-10-03 11:10:06.321606 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1504. 2017-10-03 11:10:06.321663 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 21 0x7f6e74063c50 osd_op_reply(141 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8
  1505. 2017-10-03 11:10:06.321677 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 21 ==== osd_op_reply(141 rbd_header.14481e238e1f29 [call] v0'0 uv22005940 ondisk = 0) v8 ==== 169+0+115 (932069256 0 2118929215) 0x7f6e74063c50 con 0x7f6e600050d0
  1506. 2017-10-03 11:10:06.321710 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 284 to dispatch throttler 284/104857600
  1507. 2017-10-03 11:10:06.321845 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_command({"prefix": "osd blacklist", "blacklistop": "add", "addr": "10.10.32.152:0/3393698712"} v 0) v1 -- 0x7f6e5c029fb0 con 0
  1508. 2017-10-03 11:10:06.321915 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  1509. 2017-10-03 11:10:06.321995 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 203 remaining bytes 0
  1510. 2017-10-03 11:10:06.322005 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x7f6e5c029fb0 done.
  1511. 2017-10-03 11:10:07.378117 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  1512. 2017-10-03 11:10:07.378183 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  1513. 2017-10-03 11:10:07.378198 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 8 0x7f6e7409f7e0 osd_map(158050..158050 src has 157392..158050) v3
  1514. 2017-10-03 11:10:07.378285 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 8 ==== osd_map(158050..158050 src has 157392..158050) v3 ==== 287+0+0 (1424526329 0 0) 0x7f6e7409f7e0 con 0x56221c9e3b10
  1515. 2017-10-03 11:10:07.378418 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 287 to dispatch throttler 287/104857600
  1516. 2017-10-03 11:10:07.378772 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  1517. 2017-10-03 11:10:07.378812 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  1518. 2017-10-03 11:10:07.378819 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 9 0x7f6e7409f7e0 mon_command_ack([{"prefix": "osd blacklist", "blacklistop": "add", "addr": "10.10.32.152:0/3393698712"}]=0 blacklisting 10.10.32.152:0/3393698712 until 2017-10-03 12:10:06.322347 (3600 sec) v158050) v1
  1519. 2017-10-03 11:10:07.378868 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 9 ==== mon_command_ack([{"prefix": "osd blacklist", "blacklistop": "add", "addr": "10.10.32.152:0/3393698712"}]=0 blacklisting 10.10.32.152:0/3393698712 until 2017-10-03 12:10:06.322347 (3600 sec) v158050) v1 ==== 202+0+0 (2119414071 0 0) 0x7f6e7409f7e0 con 0x56221c9e3b10
  1520. 2017-10-03 11:10:07.378941 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 202 to dispatch throttler 202/104857600
  1521. 2017-10-03 11:10:07.379068 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e5c029fb0 con 0
  1522. 2017-10-03 11:10:07.379150 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  1523. 2017-10-03 11:10:07.379247 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 93 remaining bytes 0
  1524. 2017-10-03 11:10:07.379260 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x7f6e5c029fb0 done.
  1525. 2017-10-03 11:10:07.381406 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process aborted = 0
  1526. 2017-10-03 11:10:07.381441 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1).process no session security set
  1527. 2017-10-03 11:10:07.381451 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4570608 cs=1 l=1). rx mon.0 seq 10 0x7f6e740b7630 mon_get_version_reply(handle=1 version=158050) v2
  1528. 2017-10-03 11:10:07.381524 7f6e7d7fa700 1 -- 10.10.32.152:0/3071624645 <== mon.0 10.10.4.36:6789/0 10 ==== mon_get_version_reply(handle=1 version=158050) v2 ==== 24+0+0 (3483874933 0 0) 0x7f6e740b7630 con 0x56221c9e3b10
  1529. 2017-10-03 11:10:07.381568 7f6e7d7fa700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 24 to dispatch throttler 24/104857600
  1530. 2017-10-03 11:10:07.381738 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:142 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call lock.break_lock] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c02ccf0 con 0
  1531. 2017-10-03 11:10:07.381855 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1532. 2017-10-03 11:10:07.382017 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 374 remaining bytes 0
  1533. 2017-10-03 11:10:07.382034 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e5c02ccf0 done.
  1534. 2017-10-03 11:10:07.405584 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1535. 2017-10-03 11:10:07.405688 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 22 0x7f6e74027170 osd_op_reply(142 rbd_header.14481e238e1f29 [call] v158050'22005970 uv22005970 ondisk = 0) v8
  1536. 2017-10-03 11:10:07.405705 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 22 ==== osd_op_reply(142 rbd_header.14481e238e1f29 [call] v158050'22005970 uv22005970 ondisk = 0) v8 ==== 169+0+0 (292466576 0 0) 0x7f6e74027170 con 0x7f6e600050d0
  1537. 2017-10-03 11:10:07.405752 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  1538. 2017-10-03 11:10:07.405877 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:143 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [call lock.lock] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e60074c80 con 0
  1539. 2017-10-03 11:10:07.405966 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1540. 2017-10-03 11:10:07.406076 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 385 remaining bytes 0
  1541. 2017-10-03 11:10:07.406093 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e60074c80 done.
  1542. 2017-10-03 11:10:07.408806 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1543. 2017-10-03 11:10:07.408868 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 23 0x7f6e74027b80 osd_op_reply(143 rbd_header.14481e238e1f29 [call] v158050'22005971 uv22005971 ondisk = 0) v8
  1544. 2017-10-03 11:10:07.408884 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 23 ==== osd_op_reply(143 rbd_header.14481e238e1f29 [call] v158050'22005971 uv22005971 ondisk = 0) v8 ==== 169+0+0 (115199832 0 0) 0x7f6e74027b80 con 0x7f6e600050d0
  1545. 2017-10-03 11:10:07.408921 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  1546. 2017-10-03 11:10:07.409108 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 create_connect 10.10.252.9:6804/28944, creating connection and registering
  1547. 2017-10-03 11:10:07.409158 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_NONE pgs=0 cs=0 l=1)._connect csq=0
  1548. 2017-10-03 11:10:07.409183 7f6e6d7fa700 10 -- 10.10.32.152:0/3071624645 get_connection osd.2 10.10.252.9:6804/28944 new 0x7f6e5c030660
  1549. 2017-10-03 11:10:07.409206 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6804/28944 -- osd_op(unknown.0.0:144 3.56 3:6a487cd9:::rbd_object_map.14481e238e1f29:head [call lock.lock] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c02de80 con 0
  1550. 2017-10-03 11:10:07.409308 7f6e7f7fe700 10 NetHandler reconnect reconnect: Operation already in progress
  1551. 2017-10-03 11:10:07.409324 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection nonblock connect inprogress
  1552. 2017-10-03 11:10:07.409351 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1).handle_write
  1553. 2017-10-03 11:10:07.409776 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._process_connection connect successfully, ready to send banner
  1554. 2017-10-03 11:10:07.409858 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=1)._try_send sent bytes 9 remaining bytes 0
  1555. 2017-10-03 11:10:07.409874 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._process_connection connect write banner done: 10.10.252.9:6804/28944
  1556. 2017-10-03 11:10:07.409899 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_write
  1557. 2017-10-03 11:10:07.409912 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  1558. 2017-10-03 11:10:07.410239 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1)._try_send sent bytes 136 remaining bytes 0
  1559. 2017-10-03 11:10:07.410274 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sent my addr 10.10.32.152:0/3071624645
  1560. 2017-10-03 11:10:07.410327 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect_msg.authorizer_len=174 protocol=2
  1561. 2017-10-03 11:10:07.410340 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._process_connection connect sending gseq=10 cseq=0 proto=24
  1562. 2017-10-03 11:10:07.410370 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1)._try_send sent bytes 207 remaining bytes 0
  1563. 2017-10-03 11:10:07.410384 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1).handle_write
  1564. 2017-10-03 11:10:07.410393 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=1)._try_send sent bytes 0 remaining bytes 0
  1565. 2017-10-03 11:10:07.410849 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1)._process_connection reply.authorizer_len=36
  1566. 2017-10-03 11:10:07.410933 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
  1567. 2017-10-03 11:10:07.410944 7f6e7f7fe700 2 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._process_connection got newly_acked_seq 0 vs out_seq 0
  1568. 2017-10-03 11:10:07.410951 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1).discard_requeued_up_to 0
  1569. 2017-10-03 11:10:07.411003 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=1)._try_send sent bytes 8 remaining bytes 0
  1570. 2017-10-03 11:10:07.411013 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=1)._process_connection send in_seq done
  1571. 2017-10-03 11:10:07.411019 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 2305244844532236283
  1572. 2017-10-03 11:10:07.411069 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1573. 2017-10-03 11:10:07.411195 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._try_send sent bytes 361 remaining bytes 0
  1574. 2017-10-03 11:10:07.411221 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).write_message sending 0x7f6e5c02de80 done.
  1575. 2017-10-03 11:10:07.411235 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1576. 2017-10-03 11:10:08.009331 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1).process aborted = 0
  1577. 2017-10-03 11:10:08.009422 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1). rx osd.2 seq 1 0x7f6e70123010 osd_op_reply(144 rbd_object_map.14481e238e1f29 [call] v158050'29131500 uv29131479 ondisk = -16 ((16) Device or resource busy)) v8
  1578. 2017-10-03 11:10:08.009451 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.2 10.10.252.9:6804/28944 1 ==== osd_op_reply(144 rbd_object_map.14481e238e1f29 [call] v158050'29131500 uv29131479 ondisk = -16 ((16) Device or resource busy)) v8 ==== 173+0+0 (2448649219 0 0) 0x7f6e70123010 con 0x7f6e5c030660
  1579. 2017-10-03 11:10:08.009496 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 173 to dispatch throttler 173/104857600
  1580. 2017-10-03 11:10:08.009592 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6804/28944 -- osd_op(unknown.0.0:145 3.56 3:6a487cd9:::rbd_object_map.14481e238e1f29:head [call lock.get_info] snapc 0=[] ondisk+read+known_if_redirected e158050) v8 -- 0x7f6e600745d0 con 0
  1581. 2017-10-03 11:10:08.009687 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1582. 2017-10-03 11:10:08.009843 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._try_send sent bytes 343 remaining bytes 0
  1583. 2017-10-03 11:10:08.009871 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).write_message sending 0x7f6e600745d0 done.
  1584. 2017-10-03 11:10:08.010594 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1).process aborted = 0
  1585. 2017-10-03 11:10:08.010667 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1). rx osd.2 seq 2 0x7f6e70123a80 osd_op_reply(145 rbd_object_map.14481e238e1f29 [call] v0'0 uv29131479 ondisk = 0) v8
  1586. 2017-10-03 11:10:08.010686 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.2 10.10.252.9:6804/28944 2 ==== osd_op_reply(145 rbd_object_map.14481e238e1f29 [call] v0'0 uv29131479 ondisk = 0) v8 ==== 173+0+87 (1657589077 0 3208370927) 0x7f6e70123a80 con 0x7f6e5c030660
  1587. 2017-10-03 11:10:08.010725 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 260 to dispatch throttler 260/104857600
  1588. 2017-10-03 11:10:08.010812 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6804/28944 -- osd_op(unknown.0.0:146 3.56 3:6a487cd9:::rbd_object_map.14481e238e1f29:head [call lock.break_lock] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e60074500 con 0
  1589. 2017-10-03 11:10:08.010928 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1590. 2017-10-03 11:10:08.011058 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._try_send sent bytes 358 remaining bytes 0
  1591. 2017-10-03 11:10:08.011076 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).write_message sending 0x7f6e60074500 done.
  1592. 2017-10-03 11:10:08.014018 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1).process aborted = 0
  1593. 2017-10-03 11:10:08.014104 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1). rx osd.2 seq 3 0x7f6e701495a0 osd_op_reply(146 rbd_object_map.14481e238e1f29 [call] v158050'29131501 uv29131501 ondisk = 0) v8
  1594. 2017-10-03 11:10:08.014124 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.2 10.10.252.9:6804/28944 3 ==== osd_op_reply(146 rbd_object_map.14481e238e1f29 [call] v158050'29131501 uv29131501 ondisk = 0) v8 ==== 173+0+0 (1386411870 0 0) 0x7f6e701495a0 con 0x7f6e5c030660
  1595. 2017-10-03 11:10:08.014167 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 173 to dispatch throttler 173/104857600
  1596. 2017-10-03 11:10:08.014252 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6804/28944 -- osd_op(unknown.0.0:147 3.56 3:6a487cd9:::rbd_object_map.14481e238e1f29:head [call lock.lock] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e6007c510 con 0
  1597. 2017-10-03 11:10:08.014366 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1598. 2017-10-03 11:10:08.014503 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._try_send sent bytes 361 remaining bytes 0
  1599. 2017-10-03 11:10:08.014520 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).write_message sending 0x7f6e6007c510 done.
  1600. 2017-10-03 11:10:08.017559 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1).process aborted = 0
  1601. 2017-10-03 11:10:08.017620 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1). rx osd.2 seq 4 0x7f6e70162170 osd_op_reply(147 rbd_object_map.14481e238e1f29 [call] v158050'29131502 uv29131502 ondisk = 0) v8
  1602. 2017-10-03 11:10:08.017639 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.2 10.10.252.9:6804/28944 4 ==== osd_op_reply(147 rbd_object_map.14481e238e1f29 [call] v158050'29131502 uv29131502 ondisk = 0) v8 ==== 173+0+0 (2274244439 0 0) 0x7f6e70162170 con 0x7f6e5c030660
  1603. 2017-10-03 11:10:08.017671 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 173 to dispatch throttler 173/104857600
  1604. 2017-10-03 11:10:08.017764 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6804/28944 -- osd_op(unknown.0.0:148 3.56 3:6a487cd9:::rbd_object_map.14481e238e1f29:head [call rbd.object_map_load] snapc 0=[] ondisk+read+known_if_redirected e158050) v8 -- 0x7f6e6007c510 con 0
  1605. 2017-10-03 11:10:08.017878 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1606. 2017-10-03 11:10:08.017998 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._try_send sent bytes 331 remaining bytes 0
  1607. 2017-10-03 11:10:08.018015 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).write_message sending 0x7f6e6007c510 done.
  1608. 2017-10-03 11:10:08.018811 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1).process aborted = 0
  1609. 2017-10-03 11:10:08.018874 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1). rx osd.2 seq 5 0x7f6e70164010 osd_op_reply(148 rbd_object_map.14481e238e1f29 [call] v0'0 uv29131502 ondisk = 0) v8
  1610. 2017-10-03 11:10:08.018889 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.2 10.10.252.9:6804/28944 5 ==== osd_op_reply(148 rbd_object_map.14481e238e1f29 [call] v0'0 uv29131502 ondisk = 0) v8 ==== 173+0+534 (851025604 0 3207054690) 0x7f6e70164010 con 0x7f6e5c030660
  1611. 2017-10-03 11:10:08.018923 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 707 to dispatch throttler 707/104857600
  1612. 2017-10-03 11:10:08.019164 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:149 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [notify cookie 140111966820080] snapc 0=[] ondisk+read+known_if_redirected e158050) v8 -- 0x7f6e5c02ccf0 con 0
  1613. 2017-10-03 11:10:08.019282 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1614. 2017-10-03 11:10:08.019361 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:150 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [write 2097152~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c02de80 con 0
  1615. 2017-10-03 11:10:08.019419 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 347 remaining bytes 0
  1616. 2017-10-03 11:10:08.019433 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1617. 2017-10-03 11:10:08.019442 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e5c02ccf0 done.
  1618. 2017-10-03 11:10:08.019513 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:151 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [write 4038656~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c034fd0 con 0
  1619. 2017-10-03 11:10:08.019564 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 8540 remaining bytes 0
  1620. 2017-10-03 11:10:08.019585 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c02de80 done.
  1621. 2017-10-03 11:10:08.019634 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:152 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [write 4104192~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c0357b0 con 0
  1622. 2017-10-03 11:10:08.019663 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1623. 2017-10-03 11:10:08.019672 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c034fd0 done.
  1624. 2017-10-03 11:10:08.019718 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1625. 2017-10-03 11:10:08.019733 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c0357b0 done.
  1626. 2017-10-03 11:10:08.019763 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1627. 2017-10-03 11:10:08.019773 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1628. 2017-10-03 11:10:08.019783 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:153 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [write 4169728~12288] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c036060 con 0
  1629. 2017-10-03 11:10:08.019882 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1630. 2017-10-03 11:10:08.019922 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:154 3.c7 3:e31b5912:::rbd_data.14481e238e1f29.000000000000003d:head [write 4186112~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c037690 con 0
  1631. 2017-10-03 11:10:08.020063 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 12636 remaining bytes 0
  1632. 2017-10-03 11:10:08.020086 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c036060 done.
  1633. 2017-10-03 11:10:08.020074 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:155 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 4096~12288] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c039040 con 0
  1634. 2017-10-03 11:10:08.020141 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1635. 2017-10-03 11:10:08.020173 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1636. 2017-10-03 11:10:08.020188 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c037690 done.
  1637. 2017-10-03 11:10:08.020242 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1638. 2017-10-03 11:10:08.020252 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:156 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 24576~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c037710 con 0
  1639. 2017-10-03 11:10:08.020381 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 12636 remaining bytes 0
  1640. 2017-10-03 11:10:08.020402 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c039040 done.
  1641. 2017-10-03 11:10:08.020402 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:157 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 32768~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c03b370 con 0
  1642. 2017-10-03 11:10:08.020467 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1643. 2017-10-03 11:10:08.020479 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c037710 done.
  1644. 2017-10-03 11:10:08.020523 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 8540 remaining bytes 0
  1645. 2017-10-03 11:10:08.020535 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c03b370 done.
  1646. 2017-10-03 11:10:08.020533 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:158 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 45056~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c03bff0 con 0
  1647. 2017-10-03 11:10:08.020554 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1648. 2017-10-03 11:10:08.020591 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 3076 remaining bytes 1368
  1649. 2017-10-03 11:10:08.020600 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c03bff0 continuely.
  1650. 2017-10-03 11:10:08.020614 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 1368
  1651. 2017-10-03 11:10:08.020621 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1652. 2017-10-03 11:10:08.020627 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 1368
  1653. 2017-10-03 11:10:08.020639 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1654. 2017-10-03 11:10:08.020645 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 1368
  1655. 2017-10-03 11:10:08.020662 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:159 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 53248~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c03cc30 con 0
  1656. 2017-10-03 11:10:08.020731 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1657. 2017-10-03 11:10:08.020745 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1658. 2017-10-03 11:10:08.020788 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 24 0x7f6e740bd440 watch-notify(notify (1) cookie 140112034088384 notify 678819581162113 ret 0) v3
  1659. 2017-10-03 11:10:08.020811 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 5812
  1660. 2017-10-03 11:10:08.020803 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:160 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 61440~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c03e290 con 0
  1661. 2017-10-03 11:10:08.020811 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 24 ==== watch-notify(notify (1) cookie 140112034088384 notify 678819581162113 ret 0) v3 ==== 68+0+0 (1607540617 0 0) 0x7f6e740bd440 con 0x7f6e600050d0
  1662. 2017-10-03 11:10:08.020823 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c03cc30 continuely.
  1663. 2017-10-03 11:10:08.020843 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 68 to dispatch throttler 68/104857600
  1664. 2017-10-03 11:10:08.020859 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1665. 2017-10-03 11:10:08.020860 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 5812
  1666. 2017-10-03 11:10:08.020879 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1667. 2017-10-03 11:10:08.020900 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 25 0x7f6e740bdde0 osd_op_reply(149 rbd_header.14481e238e1f29 [notify cookie 140111966820080] v0'0 uv22005971 ondisk = 0) v8
  1668. 2017-10-03 11:10:08.020937 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 10256
  1669. 2017-10-03 11:10:08.020947 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c03e290 continuely.
  1670. 2017-10-03 11:10:08.020966 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 10256
  1671. 2017-10-03 11:10:08.020966 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:162 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 81920~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c03f420 con 0
  1672. 2017-10-03 11:10:08.020966 7f6e6dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:161 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [notify-ack cookie 0] snapc 0=[] ondisk+read+known_if_redirected e158050) v8 -- 0x7f6e6007c510 con 0
  1673. 2017-10-03 11:10:08.021011 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1674. 2017-10-03 11:10:08.021077 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 14700
  1675. 2017-10-03 11:10:08.021094 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c03f420 continuely.
  1676. 2017-10-03 11:10:08.021088 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:163 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 90112~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c040560 con 0
  1677. 2017-10-03 11:10:08.021123 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 14700
  1678. 2017-10-03 11:10:08.021144 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1679. 2017-10-03 11:10:08.021224 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 19144
  1680. 2017-10-03 11:10:08.021223 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:164 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 98304~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c041710 con 0
  1681. 2017-10-03 11:10:08.021252 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c040560 continuely.
  1682. 2017-10-03 11:10:08.021269 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 19144
  1683. 2017-10-03 11:10:08.021287 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1684. 2017-10-03 11:10:08.021347 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:165 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 114688~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c0428a0 con 0
  1685. 2017-10-03 11:10:08.021354 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 27684
  1686. 2017-10-03 11:10:08.021385 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c041710 continuely.
  1687. 2017-10-03 11:10:08.021402 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 27684
  1688. 2017-10-03 11:10:08.021420 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1689. 2017-10-03 11:10:08.021471 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:166 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 131072~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c043ae0 con 0
  1690. 2017-10-03 11:10:08.021478 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 32128
  1691. 2017-10-03 11:10:08.021504 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c0428a0 continuely.
  1692. 2017-10-03 11:10:08.021521 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 32128
  1693. 2017-10-03 11:10:08.021540 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1694. 2017-10-03 11:10:08.021588 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:167 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 139264~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c044cf0 con 0
  1695. 2017-10-03 11:10:08.021605 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 36572
  1696. 2017-10-03 11:10:08.021619 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c043ae0 continuely.
  1697. 2017-10-03 11:10:08.021635 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 36572
  1698. 2017-10-03 11:10:08.021653 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1699. 2017-10-03 11:10:08.021697 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:168 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 167936~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c045e80 con 0
  1700. 2017-10-03 11:10:08.021719 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 41016
  1701. 2017-10-03 11:10:08.021733 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c044cf0 continuely.
  1702. 2017-10-03 11:10:08.021753 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 41016
  1703. 2017-10-03 11:10:08.020918 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 25 ==== osd_op_reply(149 rbd_header.14481e238e1f29 [notify cookie 140111966820080] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+8 (2918459430 0 689718215) 0x7f6e740bdde0 con 0x7f6e600050d0
  1704. 2017-10-03 11:10:08.021772 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1705. 2017-10-03 11:10:08.021813 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:169 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 1384448~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c046f90 con 0
  1706. 2017-10-03 11:10:08.021824 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 177 to dispatch throttler 177/104857600
  1707. 2017-10-03 11:10:08.021846 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1708. 2017-10-03 11:10:08.021852 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 45460
  1709. 2017-10-03 11:10:08.021868 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c045e80 continuely.
  1710. 2017-10-03 11:10:08.021884 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 45460
  1711. 2017-10-03 11:10:08.021901 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1712. 2017-10-03 11:10:08.021903 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:170 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 1466368~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c045f20 con 0
  1713. 2017-10-03 11:10:08.021957 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 329 remaining bytes 0
  1714. 2017-10-03 11:10:08.021970 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e6007c510 done.
  1715. 2017-10-03 11:10:08.021970 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 54000
  1716. 2017-10-03 11:10:08.021985 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c046f90 continuely.
  1717. 2017-10-03 11:10:08.021985 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:171 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 2510848~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c049170 con 0
  1718. 2017-10-03 11:10:08.022004 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 54000
  1719. 2017-10-03 11:10:08.022022 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1720. 2017-10-03 11:10:08.022074 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:172 3.117 3:e8c12dff:::rbd_data.14481e238e1f29.000000000000003e:head [write 2732032~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c04a2f0 con 0
  1721. 2017-10-03 11:10:08.022089 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 58444
  1722. 2017-10-03 11:10:08.022104 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c045f20 continuely.
  1723. 2017-10-03 11:10:08.022123 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 58444
  1724. 2017-10-03 11:10:08.022133 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1725. 2017-10-03 11:10:08.022171 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- osd_op(unknown.0.0:173 3.bf 3:fd65be50:::rbd_data.14481e238e1f29.0000000000000045:head [write 3780608~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c04bb00 con 0
  1726. 2017-10-03 11:10:08.022197 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 66984
  1727. 2017-10-03 11:10:08.022212 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c049170 continuely.
  1728. 2017-10-03 11:10:08.022230 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 66984
  1729. 2017-10-03 11:10:08.022250 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1730. 2017-10-03 11:10:08.022256 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:174 3.eb 3:d77ff4fb:::rbd_data.14481e238e1f29.0000000000000047:head [write 1241088~16384] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c04d270 con 0
  1731. 2017-10-03 11:10:08.022315 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 71428
  1732. 2017-10-03 11:10:08.022330 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c04a2f0 continuely.
  1733. 2017-10-03 11:10:08.022349 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 71428
  1734. 2017-10-03 11:10:08.022342 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1735. 2017-10-03 11:10:08.022350 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:175 3.eb 3:d77ff4fb:::rbd_data.14481e238e1f29.0000000000000047:head [write 1441792~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c04a2f0 con 0
  1736. 2017-10-03 11:10:08.022360 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  1737. 2017-10-03 11:10:08.022429 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 75872
  1738. 2017-10-03 11:10:08.022442 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e5c04bb00 continuely.
  1739. 2017-10-03 11:10:08.022441 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:176 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 2228224~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c04ff10 con 0
  1740. 2017-10-03 11:10:08.022459 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 75872
  1741. 2017-10-03 11:10:08.022489 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1742. 2017-10-03 11:10:08.022544 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:177 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 2256896~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c051030 con 0
  1743. 2017-10-03 11:10:08.022545 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 16732 remaining bytes 0
  1744. 2017-10-03 11:10:08.022566 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c04d270 done.
  1745. 2017-10-03 11:10:08.022620 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1746. 2017-10-03 11:10:08.022638 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c04ff10 done.
  1747. 2017-10-03 11:10:08.022659 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1748. 2017-10-03 11:10:08.022673 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c04a2f0 done.
  1749. 2017-10-03 11:10:08.022661 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:178 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 2293760~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c04ff50 con 0
  1750. 2017-10-03 11:10:08.022696 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1751. 2017-10-03 11:10:08.022725 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1752. 2017-10-03 11:10:08.022735 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c051030 done.
  1753. 2017-10-03 11:10:08.022813 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:179 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 2654208~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c0529e0 con 0
  1754. 2017-10-03 11:10:08.022835 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1755. 2017-10-03 11:10:08.022846 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c04ff50 done.
  1756. 2017-10-03 11:10:08.022888 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1757. 2017-10-03 11:10:08.022897 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c0529e0 done.
  1758. 2017-10-03 11:10:08.022929 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1759. 2017-10-03 11:10:08.022937 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:180 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 2686976~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c053630 con 0
  1760. 2017-10-03 11:10:08.022954 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 26 0x7f6e740bec70 watch-notify(notify_complete (2) cookie 140111966820080 notify 678819581162113 ret 0) v3
  1761. 2017-10-03 11:10:08.022966 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 26 ==== watch-notify(notify_complete (2) cookie 140111966820080 notify 678819581162113 ret 0) v3 ==== 42+0+28 (4016792749 0 2028406951) 0x7f6e740bec70 con 0x7f6e600050d0
  1762. 2017-10-03 11:10:08.022998 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 70 to dispatch throttler 70/104857600
  1763. 2017-10-03 11:10:08.023007 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  1764. 2017-10-03 11:10:08.023032 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 27 0x7f6e740bf300 osd_op_reply(161 rbd_header.14481e238e1f29 [notify-ack cookie 0] v0'0 uv22005971 ondisk = 0) v8
  1765. 2017-10-03 11:10:08.023043 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 27 ==== osd_op_reply(161 rbd_header.14481e238e1f29 [notify-ack cookie 0] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (14557436 0 0) 0x7f6e740bf300 con 0x7f6e600050d0
  1766. 2017-10-03 11:10:08.023063 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  1767. 2017-10-03 11:10:08.023072 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1768. 2017-10-03 11:10:08.023062 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:181 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 2723840~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c02ea30 con 0
  1769. 2017-10-03 11:10:08.023130 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1770. 2017-10-03 11:10:08.023142 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c053630 done.
  1771. 2017-10-03 11:10:08.023161 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:182 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3022848~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c053630 con 0
  1772. 2017-10-03 11:10:08.023181 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 4188 remaining bytes 256
  1773. 2017-10-03 11:10:08.023189 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c02ea30 continuely.
  1774. 2017-10-03 11:10:08.023199 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 256
  1775. 2017-10-03 11:10:08.023205 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1776. 2017-10-03 11:10:08.023236 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:183 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3194880~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c054480 con 0
  1777. 2017-10-03 11:10:08.023247 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 4700
  1778. 2017-10-03 11:10:08.023254 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c053630 continuely.
  1779. 2017-10-03 11:10:08.023262 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 4700
  1780. 2017-10-03 11:10:08.023267 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1781. 2017-10-03 11:10:08.023300 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 9144
  1782. 2017-10-03 11:10:08.023307 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c054480 continuely.
  1783. 2017-10-03 11:10:08.023318 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 9144
  1784. 2017-10-03 11:10:08.023324 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1785. 2017-10-03 11:10:08.023318 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:184 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3211264~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c055510 con 0
  1786. 2017-10-03 11:10:08.023331 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 9144
  1787. 2017-10-03 11:10:08.023343 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1788. 2017-10-03 11:10:08.023410 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 13588
  1789. 2017-10-03 11:10:08.023424 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c055510 continuely.
  1790. 2017-10-03 11:10:08.023420 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:185 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3272704~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c0566a0 con 0
  1791. 2017-10-03 11:10:08.023439 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 13588
  1792. 2017-10-03 11:10:08.023445 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1793. 2017-10-03 11:10:08.023485 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 18032
  1794. 2017-10-03 11:10:08.023492 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c0566a0 continuely.
  1795. 2017-10-03 11:10:08.023504 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 18032
  1796. 2017-10-03 11:10:08.023512 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1797. 2017-10-03 11:10:08.023523 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 18032
  1798. 2017-10-03 11:10:08.023520 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:186 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3379200~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c057640 con 0
  1799. 2017-10-03 11:10:08.023530 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1800. 2017-10-03 11:10:08.023571 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 22476
  1801. 2017-10-03 11:10:08.023578 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c057640 continuely.
  1802. 2017-10-03 11:10:08.023594 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 22476
  1803. 2017-10-03 11:10:08.023606 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1804. 2017-10-03 11:10:08.023600 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:187 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3575808~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c057640 con 0
  1805. 2017-10-03 11:10:08.023614 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 22476
  1806. 2017-10-03 11:10:08.023620 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1807. 2017-10-03 11:10:08.023653 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 26920
  1808. 2017-10-03 11:10:08.023660 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c057640 continuely.
  1809. 2017-10-03 11:10:08.023668 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 26920
  1810. 2017-10-03 11:10:08.023678 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1811. 2017-10-03 11:10:08.023686 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 26920
  1812. 2017-10-03 11:10:08.023722 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:188 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3645440~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c059660 con 0
  1813. 2017-10-03 11:10:08.023820 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1814. 2017-10-03 11:10:08.023878 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:189 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3817472~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c05ada0 con 0
  1815. 2017-10-03 11:10:08.023929 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 31364
  1816. 2017-10-03 11:10:08.023941 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c059660 continuely.
  1817. 2017-10-03 11:10:08.023967 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 31364
  1818. 2017-10-03 11:10:08.023981 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1819. 2017-10-03 11:10:08.024002 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:190 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3899392~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c05bf80 con 0
  1820. 2017-10-03 11:10:08.024034 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 35808
  1821. 2017-10-03 11:10:08.024042 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c05ada0 continuely.
  1822. 2017-10-03 11:10:08.024055 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 35808
  1823. 2017-10-03 11:10:08.024066 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1824. 2017-10-03 11:10:08.024105 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 40252
  1825. 2017-10-03 11:10:08.024113 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c05bf80 continuely.
  1826. 2017-10-03 11:10:08.024140 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 40252
  1827. 2017-10-03 11:10:08.024136 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:191 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 3964928~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c05cff0 con 0
  1828. 2017-10-03 11:10:08.024239 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1829. 2017-10-03 11:10:08.024273 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- osd_op(unknown.0.0:192 3.1f9 3:9fe45520:::rbd_data.14481e238e1f29.000000000000023d:head [write 4112384~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c05e230 con 0
  1830. 2017-10-03 11:10:08.024348 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 44696
  1831. 2017-10-03 11:10:08.024359 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c05cff0 continuely.
  1832. 2017-10-03 11:10:08.024380 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 44696
  1833. 2017-10-03 11:10:08.024396 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  1834. 2017-10-03 11:10:08.024436 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 53236
  1835. 2017-10-03 11:10:08.024443 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e5c05e230 continuely.
  1836. 2017-10-03 11:10:08.024452 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 53236
  1837. 2017-10-03 11:10:08.024446 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:193 3.191 3:89c603c1:::rbd_data.14481e238e1f29.000000000000023e:head [write 245760~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c05f9a0 con 0
  1838. 2017-10-03 11:10:08.024516 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1839. 2017-10-03 11:10:08.024593 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:194 3.191 3:89c603c1:::rbd_data.14481e238e1f29.000000000000023e:head [write 311296~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c060ac0 con 0
  1840. 2017-10-03 11:10:08.024646 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 8540 remaining bytes 0
  1841. 2017-10-03 11:10:08.024660 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c05f9a0 done.
  1842. 2017-10-03 11:10:08.024733 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1843. 2017-10-03 11:10:08.024744 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c060ac0 done.
  1844. 2017-10-03 11:10:08.024733 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:195 3.191 3:89c603c1:::rbd_data.14481e238e1f29.000000000000023e:head [write 327680~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c061c60 con 0
  1845. 2017-10-03 11:10:08.024760 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1846. 2017-10-03 11:10:08.024839 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1847. 2017-10-03 11:10:08.024851 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c061c60 done.
  1848. 2017-10-03 11:10:08.024865 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1849. 2017-10-03 11:10:08.024871 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:196 3.191 3:89c603c1:::rbd_data.14481e238e1f29.000000000000023e:head [write 983040~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c061d00 con 0
  1850. 2017-10-03 11:10:08.024977 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1851. 2017-10-03 11:10:08.025024 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6804/26510 -- osd_op(unknown.0.0:197 3.191 3:89c603c1:::rbd_data.14481e238e1f29.000000000000023e:head [write 2875392~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c063fe0 con 0
  1852. 2017-10-03 11:10:08.025105 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1853. 2017-10-03 11:10:08.025122 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c061d00 done.
  1854. 2017-10-03 11:10:08.025197 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:198 3.ee 3:7728296e:::rbd_data.14481e238e1f29.000000000000025d:head [write 2097152~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c0658d0 con 0
  1855. 2017-10-03 11:10:08.025219 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1856. 2017-10-03 11:10:08.025232 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).write_message sending 0x7f6e5c063fe0 done.
  1857. 2017-10-03 11:10:08.025272 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN pgs=8309 cs=1 l=1).handle_write
  1858. 2017-10-03 11:10:08.025280 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1859. 2017-10-03 11:10:08.025353 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1860. 2017-10-03 11:10:08.025362 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c0658d0 done.
  1861. 2017-10-03 11:10:08.025369 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:199 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2097152~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c066f70 con 0
  1862. 2017-10-03 11:10:08.025467 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1863. 2017-10-03 11:10:08.025520 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:200 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2125824~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c068120 con 0
  1864. 2017-10-03 11:10:08.025596 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1865. 2017-10-03 11:10:08.025611 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c066f70 done.
  1866. 2017-10-03 11:10:08.025678 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:201 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2162688~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c067030 con 0
  1867. 2017-10-03 11:10:08.025728 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1868. 2017-10-03 11:10:08.025740 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c068120 done.
  1869. 2017-10-03 11:10:08.025780 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1870. 2017-10-03 11:10:08.025790 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c067030 done.
  1871. 2017-10-03 11:10:08.025805 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:202 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2228224~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c067030 con 0
  1872. 2017-10-03 11:10:08.025839 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1873. 2017-10-03 11:10:08.025897 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1874. 2017-10-03 11:10:08.025911 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c067030 done.
  1875. 2017-10-03 11:10:08.025927 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1876. 2017-10-03 11:10:08.025931 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:203 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2236416~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c067030 con 0
  1877. 2017-10-03 11:10:08.025943 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1878. 2017-10-03 11:10:08.026001 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 4188 remaining bytes 4352
  1879. 2017-10-03 11:10:08.026012 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c067030 continuely.
  1880. 2017-10-03 11:10:08.026021 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 4352
  1881. 2017-10-03 11:10:08.026017 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:204 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2265088~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c06c660 con 0
  1882. 2017-10-03 11:10:08.026033 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1883. 2017-10-03 11:10:08.026064 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 8796
  1884. 2017-10-03 11:10:08.026071 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c06c660 continuely.
  1885. 2017-10-03 11:10:08.026096 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 8796
  1886. 2017-10-03 11:10:08.026108 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1887. 2017-10-03 11:10:08.026115 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 8796
  1888. 2017-10-03 11:10:08.026108 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:205 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2359296~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c06c720 con 0
  1889. 2017-10-03 11:10:08.026137 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1890. 2017-10-03 11:10:08.026168 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 13240
  1891. 2017-10-03 11:10:08.026175 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c06c720 continuely.
  1892. 2017-10-03 11:10:08.026200 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 13240
  1893. 2017-10-03 11:10:08.026229 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:206 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2555904~8192] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c06e4a0 con 0
  1894. 2017-10-03 11:10:08.026266 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1895. 2017-10-03 11:10:08.026316 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 21780
  1896. 2017-10-03 11:10:08.026324 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c06e4a0 continuely.
  1897. 2017-10-03 11:10:08.026333 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 21780
  1898. 2017-10-03 11:10:08.026352 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:207 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2592768~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c06e560 con 0
  1899. 2017-10-03 11:10:08.026390 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1900. 2017-10-03 11:10:08.026433 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 26224
  1901. 2017-10-03 11:10:08.026441 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c06e560 continuely.
  1902. 2017-10-03 11:10:08.026450 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 26224
  1903. 2017-10-03 11:10:08.026479 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:208 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2752512~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c0707f0 con 0
  1904. 2017-10-03 11:10:08.026518 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1905. 2017-10-03 11:10:08.026561 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 30668
  1906. 2017-10-03 11:10:08.026580 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c0707f0 continuely.
  1907. 2017-10-03 11:10:08.026605 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 30668
  1908. 2017-10-03 11:10:08.026601 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:209 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 2846720~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c071ea0 con 0
  1909. 2017-10-03 11:10:08.026631 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1910. 2017-10-03 11:10:08.026679 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 35112
  1911. 2017-10-03 11:10:08.026686 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c071ea0 continuely.
  1912. 2017-10-03 11:10:08.026696 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 35112
  1913. 2017-10-03 11:10:08.026695 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:210 3.6 3:6031d03f:::rbd_data.14481e238e1f29.000000000000043d:head [write 3104768~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c072ff0 con 0
  1914. 2017-10-03 11:10:08.026724 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1915. 2017-10-03 11:10:08.026767 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 39556
  1916. 2017-10-03 11:10:08.026774 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c072ff0 continuely.
  1917. 2017-10-03 11:10:08.026785 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 39556
  1918. 2017-10-03 11:10:08.026788 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.1:6800/18889 -- osd_op(unknown.0.0:211 3.d0 3:0b6ea6b9:::rbd_data.14481e238e1f29.000000000000043e:head [write 1531904~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c072ff0 con 0
  1919. 2017-10-03 11:10:08.026829 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).handle_write
  1920. 2017-10-03 11:10:08.026894 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:212 3.1e9 3:97e95285:::rbd_data.14481e238e1f29.0000000000000446:head [write 1400832~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c075e50 con 0
  1921. 2017-10-03 11:10:08.026928 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1922. 2017-10-03 11:10:08.026938 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN pgs=11480 cs=1 l=1).write_message sending 0x7f6e5c072ff0 done.
  1923. 2017-10-03 11:10:08.026948 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1924. 2017-10-03 11:10:08.027035 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- osd_op(unknown.0.0:213 3.1e9 3:97e95285:::rbd_data.14481e238e1f29.0000000000000446:head [write 2072576~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c076fd0 con 0
  1925. 2017-10-03 11:10:08.027090 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 44000
  1926. 2017-10-03 11:10:08.027110 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c075e50 continuely.
  1927. 2017-10-03 11:10:08.027128 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 44000
  1928. 2017-10-03 11:10:08.027137 7f6e6d7fa700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6804/28944 -- osd_op(unknown.0.0:214 3.199 3:9983f3b3:::rbd_data.14481e238e1f29.0000000000000448:head [write 2945024~4096] snapc 193b0=[193b0,19367,192fa] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e5c075ef0 con 0
  1929. 2017-10-03 11:10:08.027149 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  1930. 2017-10-03 11:10:08.027224 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 48444
  1931. 2017-10-03 11:10:08.027240 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e5c076fd0 continuely.
  1932. 2017-10-03 11:10:08.027256 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 48444
  1933. 2017-10-03 11:10:08.027273 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).handle_write
  1934. 2017-10-03 11:10:08.027409 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1)._try_send sent bytes 4444 remaining bytes 0
  1935. 2017-10-03 11:10:08.027425 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN pgs=6869 cs=1 l=1).write_message sending 0x7f6e5c075ef0 done.
  1936. 2017-10-03 11:10:08.037482 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1937. 2017-10-03 11:10:08.037586 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 20 0x7f6e700a2000 osd_op_reply(150 rbd_data.14481e238e1f29.000000000000003d [write 2097152~8192] v158050'25292734 uv25292734 ondisk = 0) v8
  1938. 2017-10-03 11:10:08.037659 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 20 ==== osd_op_reply(150 rbd_data.14481e238e1f29.000000000000003d [write 2097152~8192] v158050'25292734 uv25292734 ondisk = 0) v8 ==== 184+0+0 (214531746 0 0) 0x7f6e700a2000 con 0x7f6e5c008a70
  1939. 2017-10-03 11:10:08.037679 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1).process aborted = 0
  1940. 2017-10-03 11:10:08.037716 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 368/104857600
  1941. 2017-10-03 11:10:08.037742 7f6e7e7fc700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6800/18889 conn(0x7f6e5c002f50 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=11480 cs=1 l=1). rx osd.1 seq 4 0x7f6e68122170 osd_op_reply(211 rbd_data.14481e238e1f29.000000000000043e [write 1531904~4096] v158050'40336229 uv40336229 ondisk = 0) v8
  1942. 2017-10-03 11:10:08.037772 7f6e7e7fc700 1 -- 10.10.32.152:0/3071624645 <== osd.1 10.10.252.1:6800/18889 4 ==== osd_op_reply(211 rbd_data.14481e238e1f29.000000000000043e [write 1531904~4096] v158050'40336229 uv40336229 ondisk = 0) v8 ==== 184+0+0 (3671261703 0 0) 0x7f6e68122170 con 0x7f6e5c002f50
  1943. 2017-10-03 11:10:08.037811 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1944. 2017-10-03 11:10:08.037916 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1945. 2017-10-03 11:10:08.037982 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 21 0x7f6e700a28f0 osd_op_reply(151 rbd_data.14481e238e1f29.000000000000003d [write 4038656~4096] v158050'25292735 uv25292735 ondisk = 0) v8
  1946. 2017-10-03 11:10:08.038006 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 21 ==== osd_op_reply(151 rbd_data.14481e238e1f29.000000000000003d [write 4038656~4096] v158050'25292735 uv25292735 ondisk = 0) v8 ==== 184+0+0 (2010800943 0 0) 0x7f6e700a28f0 con 0x7f6e5c008a70
  1947. 2017-10-03 11:10:08.038038 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1948. 2017-10-03 11:10:08.038078 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1949. 2017-10-03 11:10:08.038126 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 22 0x7f6e701938f0 osd_op_reply(193 rbd_data.14481e238e1f29.000000000000023e [write 245760~8192] v158050'15599276 uv15599276 ondisk = 0) v8
  1950. 2017-10-03 11:10:08.038142 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 22 ==== osd_op_reply(193 rbd_data.14481e238e1f29.000000000000023e [write 245760~8192] v158050'15599276 uv15599276 ondisk = 0) v8 ==== 184+0+0 (3498783070 0 0) 0x7f6e701938f0 con 0x7f6e5c008a70
  1951. 2017-10-03 11:10:08.038166 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1952. 2017-10-03 11:10:08.038181 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1953. 2017-10-03 11:10:08.038218 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 23 0x7f6e70193f50 osd_op_reply(194 rbd_data.14481e238e1f29.000000000000023e [write 311296~4096] v158050'15599277 uv15599277 ondisk = 0) v8
  1954. 2017-10-03 11:10:08.038233 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 23 ==== osd_op_reply(194 rbd_data.14481e238e1f29.000000000000023e [write 311296~4096] v158050'15599277 uv15599277 ondisk = 0) v8 ==== 184+0+0 (313803525 0 0) 0x7f6e70193f50 con 0x7f6e5c008a70
  1955. 2017-10-03 11:10:08.038255 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1956. 2017-10-03 11:10:08.038270 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1957. 2017-10-03 11:10:08.038300 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 24 0x7f6e70193f50 osd_op_reply(195 rbd_data.14481e238e1f29.000000000000023e [write 327680~4096] v158050'15599278 uv15599278 ondisk = 0) v8
  1958. 2017-10-03 11:10:08.038318 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 24 ==== osd_op_reply(195 rbd_data.14481e238e1f29.000000000000023e [write 327680~4096] v158050'15599278 uv15599278 ondisk = 0) v8 ==== 184+0+0 (2964242204 0 0) 0x7f6e70193f50 con 0x7f6e5c008a70
  1959. 2017-10-03 11:10:08.038339 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1960. 2017-10-03 11:10:08.038353 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1961. 2017-10-03 11:10:08.038384 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 25 0x7f6e70194fb0 osd_op_reply(196 rbd_data.14481e238e1f29.000000000000023e [write 983040~4096] v158050'15599279 uv15599279 ondisk = 0) v8
  1962. 2017-10-03 11:10:08.038399 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 25 ==== osd_op_reply(196 rbd_data.14481e238e1f29.000000000000023e [write 983040~4096] v158050'15599279 uv15599279 ondisk = 0) v8 ==== 184+0+0 (2921787489 0 0) 0x7f6e70194fb0 con 0x7f6e5c008a70
  1963. 2017-10-03 11:10:08.038423 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1964. 2017-10-03 11:10:08.038434 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1965. 2017-10-03 11:10:08.038464 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 26 0x7f6e70195700 osd_op_reply(197 rbd_data.14481e238e1f29.000000000000023e [write 2875392~4096] v158050'15599280 uv15599280 ondisk = 0) v8
  1966. 2017-10-03 11:10:08.038481 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 26 ==== osd_op_reply(197 rbd_data.14481e238e1f29.000000000000023e [write 2875392~4096] v158050'15599280 uv15599280 ondisk = 0) v8 ==== 184+0+0 (2678681574 0 0) 0x7f6e70195700 con 0x7f6e5c008a70
  1967. 2017-10-03 11:10:08.038502 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1968. 2017-10-03 11:10:08.040233 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1969. 2017-10-03 11:10:08.040388 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 27 0x7f6e70195e40 osd_op_reply(174 rbd_data.14481e238e1f29.0000000000000047 [write 1241088~16384] v158050'19624224 uv19624224 ondisk = 0) v8
  1970. 2017-10-03 11:10:08.040418 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 27 ==== osd_op_reply(174 rbd_data.14481e238e1f29.0000000000000047 [write 1241088~16384] v158050'19624224 uv19624224 ondisk = 0) v8 ==== 184+0+0 (4219625176 0 0) 0x7f6e70195e40 con 0x7f6e5c008a70
  1971. 2017-10-03 11:10:08.040459 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1972. 2017-10-03 11:10:08.040508 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1973. 2017-10-03 11:10:08.040564 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 28 0x7f6e70196580 osd_op_reply(175 rbd_data.14481e238e1f29.0000000000000047 [write 1441792~4096] v158050'19624225 uv19624225 ondisk = 0) v8
  1974. 2017-10-03 11:10:08.040586 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 28 ==== osd_op_reply(175 rbd_data.14481e238e1f29.0000000000000047 [write 1441792~4096] v158050'19624225 uv19624225 ondisk = 0) v8 ==== 184+0+0 (2578484698 0 0) 0x7f6e70196580 con 0x7f6e5c008a70
  1975. 2017-10-03 11:10:08.040617 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1976. 2017-10-03 11:10:08.041091 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1977. 2017-10-03 11:10:08.041164 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 29 0x7f6e70196cc0 osd_op_reply(152 rbd_data.14481e238e1f29.000000000000003d [write 4104192~4096] v158050'25292736 uv25292736 ondisk = 0) v8
  1978. 2017-10-03 11:10:08.041185 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 29 ==== osd_op_reply(152 rbd_data.14481e238e1f29.000000000000003d [write 4104192~4096] v158050'25292736 uv25292736 ondisk = 0) v8 ==== 184+0+0 (1267807665 0 0) 0x7f6e70196cc0 con 0x7f6e5c008a70
  1979. 2017-10-03 11:10:08.041221 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1980. 2017-10-03 11:10:08.041234 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1981. 2017-10-03 11:10:08.041265 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 30 0x7f6e70197400 osd_op_reply(153 rbd_data.14481e238e1f29.000000000000003d [write 4169728~12288] v158050'25292737 uv25292737 ondisk = 0) v8
  1982. 2017-10-03 11:10:08.041286 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 30 ==== osd_op_reply(153 rbd_data.14481e238e1f29.000000000000003d [write 4169728~12288] v158050'25292737 uv25292737 ondisk = 0) v8 ==== 184+0+0 (2548503428 0 0) 0x7f6e70197400 con 0x7f6e5c008a70
  1983. 2017-10-03 11:10:08.041318 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1984. 2017-10-03 11:10:08.041331 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1).process aborted = 0
  1985. 2017-10-03 11:10:08.041378 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.1:6804/26510 conn(0x7f6e5c008a70 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=8309 cs=1 l=1). rx osd.9 seq 31 0x7f6e70197b40 osd_op_reply(154 rbd_data.14481e238e1f29.000000000000003d [write 4186112~4096] v158050'25292738 uv25292738 ondisk = 0) v8
  1986. 2017-10-03 11:10:08.041399 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.9 10.10.252.1:6804/26510 31 ==== osd_op_reply(154 rbd_data.14481e238e1f29.000000000000003d [write 4186112~4096] v158050'25292738 uv25292738 ondisk = 0) v8 ==== 184+0+0 (2406273618 0 0) 0x7f6e70197b40 con 0x7f6e5c008a70
  1987. 2017-10-03 11:10:08.041430 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  1988. 2017-10-03 11:10:08.705714 7f6e6ffff700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).send_keepalive
  1989. 2017-10-03 11:10:08.705810 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  1990. 2017-10-03 11:10:08.705819 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._append_keepalive_or_ack
  1991. 2017-10-03 11:10:08.705901 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 9 remaining bytes 0
  1992. 2017-10-03 11:10:08.710486 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:215 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  1993. 2017-10-03 11:10:08.710544 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.4.36:6789/0 -- mon_subscribe({osdmap=158051}) v2 -- 0x7f6e50002ab0 con 0
  1994. 2017-10-03 11:10:08.710571 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  1995. 2017-10-03 11:10:08.710577 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50003010 con 0
  1996. 2017-10-03 11:10:08.710684 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  1997. 2017-10-03 11:10:08.710691 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  1998. 2017-10-03 11:10:08.710724 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  1999. 2017-10-03 11:10:08.710728 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50003010 done.
  2000. 2017-10-03 11:10:08.710733 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  2001. 2017-10-03 11:10:08.710769 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 98 remaining bytes 0
  2002. 2017-10-03 11:10:08.710773 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).write_message sending 0x7f6e50002ab0 done.
  2003. 2017-10-03 11:10:08.710781 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2004. 2017-10-03 11:10:08.711322 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2005. 2017-10-03 11:10:08.711371 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 28 0x7f6e740d3340 osd_op_reply(215 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2006. 2017-10-03 11:10:08.711378 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 28 ==== osd_op_reply(215 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740d3340 con 0x7f6e600050d0
  2007. 2017-10-03 11:10:08.711389 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  2008. 2017-10-03 11:10:09.498661 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  2009. 2017-10-03 11:10:09.498711 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 32 0x7f6e740d3fe0 osd_op_reply(176 rbd_data.14481e238e1f29.000000000000023d [write 2228224~4096] v158050'37094891 uv37094891 ondisk = 0) v8
  2010. 2017-10-03 11:10:09.498724 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 32 ==== osd_op_reply(176 rbd_data.14481e238e1f29.000000000000023d [write 2228224~4096] v158050'37094891 uv37094891 ondisk = 0) v8 ==== 184+0+0 (1443732872 0 0) 0x7f6e740d3fe0 con 0x7f6e5c00f790
  2011. 2017-10-03 11:10:09.498747 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  2012. 2017-10-03 11:10:09.530497 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  2013. 2017-10-03 11:10:09.530577 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 25 0x7f6e70198280 osd_op_reply(198 rbd_data.14481e238e1f29.000000000000025d [write 2097152~4096] v158050'41983846 uv41983846 ondisk = 0) v8
  2014. 2017-10-03 11:10:09.530585 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 25 ==== osd_op_reply(198 rbd_data.14481e238e1f29.000000000000025d [write 2097152~4096] v158050'41983846 uv41983846 ondisk = 0) v8 ==== 184+0+0 (10330178 0 0) 0x7f6e70198280 con 0x56221c9ef7a0
  2015. 2017-10-03 11:10:09.530654 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  2016. 2017-10-03 11:10:09.531371 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1).process aborted = 0
  2017. 2017-10-03 11:10:09.531411 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6804/28944 conn(0x7f6e5c030660 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6869 cs=1 l=1). rx osd.2 seq 6 0x7f6e70198280 osd_op_reply(214 rbd_data.14481e238e1f29.0000000000000448 [write 2945024~4096] v158050'21184783 uv21184783 ondisk = 0) v8
  2018. 2017-10-03 11:10:09.531420 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.2 10.10.252.9:6804/28944 6 ==== osd_op_reply(214 rbd_data.14481e238e1f29.0000000000000448 [write 2945024~4096] v158050'21184783 uv21184783 ondisk = 0) v8 ==== 184+0+0 (1772204485 0 0) 0x7f6e70198280 con 0x7f6e5c030660
  2019. 2017-10-03 11:10:09.531476 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  2020. 2017-10-03 11:10:13.710698 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:216 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  2021. 2017-10-03 11:10:13.710781 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50002ab0 con 0
  2022. 2017-10-03 11:10:13.710801 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2023. 2017-10-03 11:10:13.710933 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  2024. 2017-10-03 11:10:13.710959 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50002ab0 done.
  2025. 2017-10-03 11:10:13.711090 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  2026. 2017-10-03 11:10:13.711134 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  2027. 2017-10-03 11:10:13.711150 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2028. 2017-10-03 11:10:13.712111 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2029. 2017-10-03 11:10:13.712176 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 29 0x7f6e740d4910 osd_op_reply(216 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2030. 2017-10-03 11:10:13.712193 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 29 ==== osd_op_reply(216 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740d4910 con 0x7f6e600050d0
  2031. 2017-10-03 11:10:13.712220 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  2032. 2017-10-03 11:10:14.616771 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  2033. 2017-10-03 11:10:14.616767 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  2034. 2017-10-03 11:10:14.616807 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 10220 remaining bytes 38224
  2035. 2017-10-03 11:10:14.616807 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 10220 remaining bytes 43016
  2036. 2017-10-03 11:10:14.619220 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1).process aborted = 0
  2037. 2017-10-03 11:10:14.619286 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=14234 cs=1 l=1). rx osd.15 seq 33 0x7f6e740d5390 osd_op_reply(177 rbd_data.14481e238e1f29.000000000000023d [write 2256896~4096] v158050'37094892 uv37094892 ondisk = 0) v8
  2038. 2017-10-03 11:10:14.619320 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.15 10.10.252.7:6800/15314 33 ==== osd_op_reply(177 rbd_data.14481e238e1f29.000000000000023d [write 2256896~4096] v158050'37094892 uv37094892 ondisk = 0) v8 ==== 184+0+0 (1392450032 0 0) 0x7f6e740d5390 con 0x7f6e5c00f790
  2039. 2017-10-03 11:10:14.619347 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  2040. 2017-10-03 11:10:14.619515 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1).process aborted = 0
  2041. 2017-10-03 11:10:14.619536 7f6e7f7fe700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6357 cs=1 l=1). rx osd.5 seq 26 0x7f6e70189190 osd_op_reply(199 rbd_data.14481e238e1f29.000000000000043d [write 2097152~4096] v158050'24200655 uv24200655 ondisk = 0) v8
  2042. 2017-10-03 11:10:14.619559 7f6e7f7fe700 1 -- 10.10.32.152:0/3071624645 <== osd.5 10.10.252.9:6808/29179 26 ==== osd_op_reply(199 rbd_data.14481e238e1f29.000000000000043d [write 2097152~4096] v158050'24200655 uv24200655 ondisk = 0) v8 ==== 184+0+0 (1011596312 0 0) 0x7f6e70189190 con 0x56221c9ef7a0
  2043. 2017-10-03 11:10:14.619570 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 184 to dispatch throttler 184/104857600
  2044. 2017-10-03 11:10:18.705891 7f6e6ffff700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).send_keepalive
  2045. 2017-10-03 11:10:18.705964 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  2046. 2017-10-03 11:10:18.705998 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._append_keepalive_or_ack
  2047. 2017-10-03 11:10:18.706092 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 9 remaining bytes 0
  2048. 2017-10-03 11:10:18.710909 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:217 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  2049. 2017-10-03 11:10:18.710987 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- ping magic: 0 v1 -- 0x7f6e50003590 con 0
  2050. 2017-10-03 11:10:18.711005 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- ping magic: 0 v1 -- 0x7f6e50003940 con 0
  2051. 2017-10-03 11:10:18.711023 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- ping magic: 0 v1 -- 0x7f6e50003cf0 con 0
  2052. 2017-10-03 11:10:18.711044 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50004120 con 0
  2053. 2017-10-03 11:10:18.711039 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2054. 2017-10-03 11:10:18.711063 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  2055. 2017-10-03 11:10:18.711063 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  2056. 2017-10-03 11:10:18.711155 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  2057. 2017-10-03 11:10:18.711172 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 2920 remaining bytes 35379
  2058. 2017-10-03 11:10:18.711185 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 7300 remaining bytes 68647
  2059. 2017-10-03 11:10:18.711185 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50004120 done.
  2060. 2017-10-03 11:10:18.711189 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e50003590 continuely.
  2061. 2017-10-03 11:10:18.711198 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e50003cf0 continuely.
  2062. 2017-10-03 11:10:18.711205 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 35379
  2063. 2017-10-03 11:10:18.711211 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 68647
  2064. 2017-10-03 11:10:18.711299 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  2065. 2017-10-03 11:10:18.711321 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  2066. 2017-10-03 11:10:18.711338 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  2067. 2017-10-03 11:10:18.711393 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 2920 remaining bytes 40171
  2068. 2017-10-03 11:10:18.711409 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e50003940 continuely.
  2069. 2017-10-03 11:10:18.711425 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 40171
  2070. 2017-10-03 11:10:18.711446 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2071. 2017-10-03 11:10:18.712604 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2072. 2017-10-03 11:10:18.712688 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 30 0x7f6e740c4fe0 osd_op_reply(217 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2073. 2017-10-03 11:10:18.712713 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 30 ==== osd_op_reply(217 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740c4fe0 con 0x7f6e600050d0
  2074. 2017-10-03 11:10:18.712751 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  2075. 2017-10-03 11:10:23.711186 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:218 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  2076. 2017-10-03 11:10:23.711265 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- ping magic: 0 v1 -- 0x7f6e50003590 con 0
  2077. 2017-10-03 11:10:23.711273 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- ping magic: 0 v1 -- 0x7f6e50003940 con 0
  2078. 2017-10-03 11:10:23.711277 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- ping magic: 0 v1 -- 0x7f6e50004750 con 0
  2079. 2017-10-03 11:10:23.711273 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2080. 2017-10-03 11:10:23.711281 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  2081. 2017-10-03 11:10:23.711286 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50004b00 con 0
  2082. 2017-10-03 11:10:23.711299 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  2083. 2017-10-03 11:10:23.711348 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 1460 remaining bytes 67262
  2084. 2017-10-03 11:10:23.711331 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 1460 remaining bytes 33994
  2085. 2017-10-03 11:10:23.711354 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e50004750 continuely.
  2086. 2017-10-03 11:10:23.711355 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e50003590 continuely.
  2087. 2017-10-03 11:10:23.711380 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 67262
  2088. 2017-10-03 11:10:23.711380 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 33994
  2089. 2017-10-03 11:10:23.711388 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  2090. 2017-10-03 11:10:23.711396 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  2091. 2017-10-03 11:10:23.711413 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  2092. 2017-10-03 11:10:23.711419 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50004b00 done.
  2093. 2017-10-03 11:10:23.711426 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  2094. 2017-10-03 11:10:23.711449 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 1460 remaining bytes 38786
  2095. 2017-10-03 11:10:23.711456 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e50003940 continuely.
  2096. 2017-10-03 11:10:23.711461 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 38786
  2097. 2017-10-03 11:10:23.711464 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2098. 2017-10-03 11:10:23.712255 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2099. 2017-10-03 11:10:23.712273 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 31 0x7f6e740c2250 osd_op_reply(218 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2100. 2017-10-03 11:10:23.712286 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 31 ==== osd_op_reply(218 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740c2250 con 0x7f6e600050d0
  2101. 2017-10-03 11:10:23.712295 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  2102. 2017-10-03 11:10:28.706096 7f6e6ffff700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).send_keepalive
  2103. 2017-10-03 11:10:28.706202 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  2104. 2017-10-03 11:10:28.706232 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._append_keepalive_or_ack
  2105. 2017-10-03 11:10:28.706333 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 9 remaining bytes 0
  2106. 2017-10-03 11:10:28.711443 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:219 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  2107. 2017-10-03 11:10:28.711525 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- ping magic: 0 v1 -- 0x7f6e50003590 con 0
  2108. 2017-10-03 11:10:28.711536 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2109. 2017-10-03 11:10:28.711567 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- ping magic: 0 v1 -- 0x7f6e50003940 con 0
  2110. 2017-10-03 11:10:28.711581 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- ping magic: 0 v1 -- 0x7f6e50005060 con 0
  2111. 2017-10-03 11:10:28.711601 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50005410 con 0
  2112. 2017-10-03 11:10:28.711584 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  2113. 2017-10-03 11:10:28.711630 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  2114. 2017-10-03 11:10:28.711697 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 34069
  2115. 2017-10-03 11:10:28.711715 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e50003590 continuely.
  2116. 2017-10-03 11:10:28.711715 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 67337
  2117. 2017-10-03 11:10:28.711719 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  2118. 2017-10-03 11:10:28.711731 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e50005060 continuely.
  2119. 2017-10-03 11:10:28.711734 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 34069
  2120. 2017-10-03 11:10:28.711746 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  2121. 2017-10-03 11:10:28.711748 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 67337
  2122. 2017-10-03 11:10:28.711819 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  2123. 2017-10-03 11:10:28.711836 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50005410 done.
  2124. 2017-10-03 11:10:28.711861 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  2125. 2017-10-03 11:10:28.711919 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 38861
  2126. 2017-10-03 11:10:28.711936 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e50003940 continuely.
  2127. 2017-10-03 11:10:28.711953 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 38861
  2128. 2017-10-03 11:10:28.711963 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2129. 2017-10-03 11:10:28.714151 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2130. 2017-10-03 11:10:28.714233 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 32 0x7f6e740d7d50 osd_op_reply(219 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2131. 2017-10-03 11:10:28.714260 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 32 ==== osd_op_reply(219 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740d7d50 con 0x7f6e600050d0
  2132. 2017-10-03 11:10:28.714305 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  2133. 2017-10-03 11:10:33.711761 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:220 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  2134. 2017-10-03 11:10:33.711850 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- ping magic: 0 v1 -- 0x7f6e50005060 con 0
  2135. 2017-10-03 11:10:33.711866 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- ping magic: 0 v1 -- 0x7f6e50003940 con 0
  2136. 2017-10-03 11:10:33.711875 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- ping magic: 0 v1 -- 0x7f6e50005960 con 0
  2137. 2017-10-03 11:10:33.711898 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50005d10 con 0
  2138. 2017-10-03 11:10:33.711880 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2139. 2017-10-03 11:10:33.711912 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  2140. 2017-10-03 11:10:33.711932 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  2141. 2017-10-03 11:10:33.711997 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 67412
  2142. 2017-10-03 11:10:33.712016 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e50005960 continuely.
  2143. 2017-10-03 11:10:33.712014 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 34144
  2144. 2017-10-03 11:10:33.712028 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 67412
  2145. 2017-10-03 11:10:33.712018 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  2146. 2017-10-03 11:10:33.712030 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e50005060 continuely.
  2147. 2017-10-03 11:10:33.712043 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50005d10 done.
  2148. 2017-10-03 11:10:33.712048 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 34144
  2149. 2017-10-03 11:10:33.712177 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  2150. 2017-10-03 11:10:33.712207 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  2151. 2017-10-03 11:10:33.712224 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  2152. 2017-10-03 11:10:33.712277 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 38936
  2153. 2017-10-03 11:10:33.712319 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e50003940 continuely.
  2154. 2017-10-03 11:10:33.712336 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 38936
  2155. 2017-10-03 11:10:33.712361 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2156. 2017-10-03 11:10:33.713255 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2157. 2017-10-03 11:10:33.713321 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 33 0x7f6e740d8da0 osd_op_reply(220 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2158. 2017-10-03 11:10:33.713341 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 33 ==== osd_op_reply(220 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740d8da0 con 0x7f6e600050d0
  2159. 2017-10-03 11:10:33.713368 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
  2160. 2017-10-03 11:10:36.824467 7f6e59ffb700 -1 rbd-nbd: failed to read nbd request header: (33) Numerical argument out of domain
  2161. 2017-10-03 11:10:38.706268 7f6e6ffff700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).send_keepalive
  2162. 2017-10-03 11:10:38.706309 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1).handle_write
  2163. 2017-10-03 11:10:38.706321 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._append_keepalive_or_ack
  2164. 2017-10-03 11:10:38.706397 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.4.36:6789/0 conn(0x56221c9e3b10 :-1 s=STATE_OPEN pgs=4570608 cs=1 l=1)._try_send sent bytes 9 remaining bytes 0
  2165. 2017-10-03 11:10:38.711992 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- osd_op(unknown.0.0:221 3.43 3:c25a8f07:::rbd_header.14481e238e1f29:head [watch ping cookie 140112034088384] snapc 0=[] ondisk+write+known_if_redirected e158050) v8 -- 0x7f6e50000e40 con 0
  2166. 2017-10-03 11:10:38.712080 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6808/29179 -- ping magic: 0 v1 -- 0x7f6e50005060 con 0
  2167. 2017-10-03 11:10:38.712084 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2168. 2017-10-03 11:10:38.712093 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.7:6800/15314 -- ping magic: 0 v1 -- 0x7f6e50003940 con 0
  2169. 2017-10-03 11:10:38.712107 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.9:6800/28044 -- ping magic: 0 v1 -- 0x7f6e50006270 con 0
  2170. 2017-10-03 11:10:38.712116 7f6e7dffb700 1 -- 10.10.32.152:0/3071624645 --> 10.10.252.4:6804/25402 -- ping magic: 0 v1 -- 0x7f6e50006620 con 0
  2171. 2017-10-03 11:10:38.712117 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).handle_write
  2172. 2017-10-03 11:10:38.712129 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).handle_write
  2173. 2017-10-03 11:10:38.712185 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 1460 remaining bytes 32759
  2174. 2017-10-03 11:10:38.712192 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1).write_message sending 0x7f6e50005060 continuely.
  2175. 2017-10-03 11:10:38.712186 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 1460 remaining bytes 66027
  2176. 2017-10-03 11:10:38.712195 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1).write_message sending 0x7f6e50006270 continuely.
  2177. 2017-10-03 11:10:38.712196 7f6e7f7fe700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6808/29179 conn(0x56221c9ef7a0 :-1 s=STATE_OPEN pgs=6357 cs=1 l=1)._try_send sent bytes 0 remaining bytes 32759
  2178. 2017-10-03 11:10:38.712201 7f6e7e7fc700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.9:6800/28044 conn(0x7f6e5c015e80 :-1 s=STATE_OPEN pgs=6324 cs=1 l=1)._try_send sent bytes 0 remaining bytes 66027
  2179. 2017-10-03 11:10:38.712218 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 309 remaining bytes 0
  2180. 2017-10-03 11:10:38.712228 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50000e40 done.
  2181. 2017-10-03 11:10:38.712248 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1)._try_send sent bytes 75 remaining bytes 0
  2182. 2017-10-03 11:10:38.712253 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).write_message sending 0x7f6e50006620 done.
  2183. 2017-10-03 11:10:38.712259 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).handle_write
  2184. 2017-10-03 11:10:38.712325 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 1460 remaining bytes 37551
  2185. 2017-10-03 11:10:38.712329 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1).write_message sending 0x7f6e50003940 continuely.
  2186. 2017-10-03 11:10:38.712333 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.7:6800/15314 conn(0x7f6e5c00f790 :-1 s=STATE_OPEN pgs=14234 cs=1 l=1)._try_send sent bytes 0 remaining bytes 37551
  2187. 2017-10-03 11:10:38.712341 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN pgs=12894 cs=1 l=1).handle_write
  2188. 2017-10-03 11:10:38.713058 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1).process aborted = 0
  2189. 2017-10-03 11:10:38.713126 7f6e7effd700 5 -- 10.10.32.152:0/3071624645 >> 10.10.252.4:6804/25402 conn(0x7f6e600050d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=12894 cs=1 l=1). rx osd.8 seq 34 0x7f6e740da6e0 osd_op_reply(221 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8
  2190. 2017-10-03 11:10:38.713143 7f6e7effd700 1 -- 10.10.32.152:0/3071624645 <== osd.8 10.10.252.4:6804/25402 34 ==== osd_op_reply(221 rbd_header.14481e238e1f29 [watch ping cookie 140112034088384] v0'0 uv22005971 ondisk = 0) v8 ==== 169+0+0 (1644775618 0 0) 0x7f6e740da6e0 con 0x7f6e600050d0
  2191. 2017-10-03 11:10:38.713164 7f6e7effd700 10 -- 10.10.32.152:0/3071624645 dispatch_throttle_release 169 to dispatch throttler 169/104857600
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!