--- Log opened wo sep 27 00:00:00 2017 --- Day changed wo sep 27 2017 00:00 -!- nsoffer: has quit [Ping timeout: 240 seconds] 00:10 -!- jbrooks: has quit [Remote host closed the connection] 00:12 -!- jbrooks (Jason Brooks): has joined #vdsm 00:55 -!- jbrooks: has quit [Remote host closed the connection] 00:56 -!- jbrooks (Jason Brooks): has joined #vdsm 03:04 -!- phbailey: has quit [Ping timeout: 240 seconds] 03:17 -!- fabiand_ (Fabian Deutsch): has joined #vdsm 03:20 -!- phbailey (Phillip Bailey): has joined #vdsm 03:21 -!- fabiand: has quit [Ping timeout: 260 seconds] 03:36 -!- dimak: has quit [Ping timeout: 240 seconds] 03:37 -!- dimak (dimak): has joined #vdsm 05:26 -!- ahino: has quit [Ping timeout: 240 seconds] 05:29 -!- erav (purple): has joined #vdsm 05:43 -!- ahino (purple): has joined #vdsm 05:51 -!- danken: has quit [Ping timeout: 248 seconds] 05:56 -!- ahino: has quit [Ping timeout: 255 seconds] 06:08 -!- ahino (purple): has joined #vdsm 06:27 -!- mpolednik1 (mpolednik): has joined #vdsm 06:27 -!- msivak_ (Martin Sivak): has joined #vdsm 06:33 -!- Netsplit *.net <-> *.split quits: mpolednik, msivak 06:48 -!- ishaby (Idan Shaby): has joined #vdsm 06:57 -!- ndarshan (Darshan n): has joined #vdsm 07:28 -!- edwardh (purple): has joined #vdsm 08:14 -!- danken (purple): has joined #vdsm 08:14 -!- mode/#vdsm: by ChanServ 08:18 -!- fromani (Francesco Romani): has joined #vdsm 08:21 -!- mskrivanek_away is now known as mskrivanek 08:38 -!- tiraboschi_ (purple): has joined #vdsm 08:53 -!- mskrivanek is now known as mskrivanek_away 09:13 -!- dholler (Dominik Holler): has joined #vdsm 09:24 -!- fsimonce (Federico): has joined #vdsm 09:27 -!- bazulay (purple): has joined #vdsm 09:30 -!- mmirecki (Marcin Mirecki): has joined #vdsm 09:34 -!- rmohr (Roman Mohr): has joined #vdsm 09:52 < fromani> danken: do we want/need this for today's build? https://gerrit.ovirt.org/#/c/81472/ 09:52 < fromani> danken: (and good morning!) 10:03 -!- nsoffer (Nir Soffer): has joined #vdsm 10:07 -!- irit (purple): has joined #vdsm 10:45 -!- ishaby: has quit [Ping timeout: 252 seconds] 10:50 -!- ishaby (Idan Shaby): has joined #vdsm 10:55 -!- phoracek (phoracek): has joined #vdsm 11:10 -!- leongold: has quit [Quit: Leaving.] 11:22 -!- leongold (purple): has joined #vdsm 11:23 < tiraboschi_> nsoffer: hi Nir 11:23 < tiraboschi_> nsoffer: do you have a few minutes to talk about https://gerrit.ovirt.org/#/c/82094/ ? 11:23 < nsoffer> tiraboschi_, no chance, sorry 11:24 < tiraboschi_> nsoffer: ok, np :-) 11:27 -!- leongold: has quit [Ping timeout: 260 seconds] 11:32 -!- fabiand_ is now known as fabiand 11:38 -!- irit: has quit [Read error: Connection reset by peer] 11:40 -!- nsoffer: has quit [Ping timeout: 255 seconds] 11:48 -!- mmirecki is now known as mmirecki_lunch 11:55 -!- pkliczew is now known as pkliczew_lunch 11:56 -!- leongold (purple): has joined #vdsm 12:05 -!- fabiand_ (Fabian Deutsch): has joined #vdsm 12:23 -!- fabiand: has quit [Quit: Verlassend] 12:29 -!- mskrivanek_away is now known as mskrivanek 12:38 -!- ishaby: has quit [Ping timeout: 240 seconds] 12:45 -!- mskrivanek is now known as mskrivanek_away 12:54 -!- ishaby (Idan Shaby): has joined #vdsm 13:06 -!- pkliczew_lunch is now known as pkliczew 13:14 -!- nsoffer (Nir Soffer): has joined #vdsm 13:17 -!- mmirecki_lunch is now known as mmirecki 13:19 -!- nsoffer: has quit [Ping timeout: 240 seconds] 13:33 -!- fabiand_ is now known as fabiand 14:03 -!- irit (purple): has joined #vdsm 14:03 -!- erav1 (purple): has joined #vdsm 14:05 -!- edwardh: has quit [Ping timeout: 240 seconds] 14:06 -!- erav: has quit [Ping timeout: 260 seconds] 14:06 -!- leongold: has quit [Ping timeout: 255 seconds] 14:09 -!- phoracek: has quit [Ping timeout: 248 seconds] 14:11 -!- leongold (purple): has joined #vdsm 14:23 -!- edwardh (purple): has joined #vdsm 14:26 -!- phoracek (phoracek): has joined #vdsm 14:27 -!- erav1: has quit [Ping timeout: 248 seconds] 14:29 -!- nsoffer (Nir Soffer): has joined #vdsm 14:39 -!- sleviim: has quit [Ping timeout: 252 seconds] 14:39 -!- ndarshan: has quit [Quit: Leaving] 14:45 -!- erav (purple): has joined #vdsm 14:56 -!- dougsland (douglas): has joined #vdsm 14:56 -!- dougsland: has quit [Changing host] 14:56 -!- dougsland (douglas): has joined #vdsm 15:08 -!- nsoffer: has quit [Ping timeout: 246 seconds] 15:11 -!- sleviim: has quit [Ping timeout: 264 seconds] 15:18 -!- erav: has quit [Quit: Leaving.] 15:19 -!- edwardh1 (purple): has joined #vdsm 15:21 -!- phoracek: has quit [Ping timeout: 240 seconds] 15:21 -!- edwardh: has quit [Ping timeout: 240 seconds] 15:23 -!- leongold: has quit [Ping timeout: 248 seconds] 15:25 -!- nsoffer (Nir Soffer): has joined #vdsm 15:34 -!- sleviim: has quit [Read error: Connection reset by peer] 15:36 -!- irit: has quit [Read error: Connection reset by peer] 15:36 -!- leongold (purple): has joined #vdsm 15:59 -!- ishaby: has quit [Ping timeout: 252 seconds] 16:04 -!- sleviim1 (purple): has joined #vdsm 16:04 -!- sleviim: has quit [Read error: Connection reset by peer] 16:49 -!- pkliczew: has quit [Ping timeout: 260 seconds] 16:59 < nsoffer> fromani, do you have more info about the libvirt requirements in https://gerrit.ovirt.org/#/c/78899/? 16:59 < nsoffer> e.g. why 3.7? 17:00 -!- mmirecki: has quit [Ping timeout: 260 seconds] 17:00 < fromani> nsoffer: no, and actually I didn't check which version is available on fedora :\ 17:01 < nsoffer> fromani, btw, we require virt-preview, right? 17:01 < fromani> yep 17:01 < fromani> nsoffer: ^ 17:02 -!- bazulay: has quit [Quit: Leaving.] 17:04 < nsoffer> fromani, do we have a reason for this in f26? 17:05 < fromani> nsoffer: I think that doing this for all the fedoras is just the simplest way 17:06 < nsoffer> fromani, if we always require virt-preview version, maybe we should add a comment about it in the spec? 17:06 < nsoffer> fromani, related to https://www.redhat.com/archives/libvir-list/2017-September/msg00939.html 17:06 < fromani> nsoffer: AFAIK we require the virt-preview *repo* to make sure the user has available the latest and greatest libvirt, and we can require it if needed in the spec 17:08 < nsoffer> fromani, the libvirt locking issue is clear - but I wonder if we are not shooting ourself in the foot 17:09 < nsoffer> fromani, by calling virDomainGetAllVmsStats with flags=0 17:09 < nsoffer> flags=0 means give me all info - including block device info for *all* devices 17:09 < nsoffer> fromani, including devices like cdrom we don't care 17:09 < fromani> nsoffer: yep, but we don't have a way to filter them 17:10 < fromani> nsoffer: we do use those values to report stats like readOps readRate readLatency 17:10 < nsoffer> fromani, do we need any block info? we don't use it for thinp 17:10 < fromani> nsoffer: so we care about the values... 17:10 < nsoffer> fromani, didn't we move that to collectd? 17:10 < fromani> nsoffer: nope, that effort was stopped 17:11 < fromani> nsoffer: I don't recall the details, but the changes on Engine side were considered too risky 17:11 < nsoffer> fromani, really? you worked on the libvirt plugin? 17:11 < fromani> nsoffer: I did, and I don't recall the *engine side* issues :) 17:11 < nsoffer> ok 17:12 < fromani> nsoffer: OTOH I do recall the collectd/libvirt pitfalls quite well 17:12 < fromani> nsoffer: the collectd plugin even had code to split the load among threads, to avoid one rogue host on one storage domain could block other hosts in different storage domains 17:13 < nsoffer> fromani, are you sure the mechanism to detect bad vms in bulks stats works? 17:13 < fromani> nsoffer: last time I checked, it worked ok 17:13 < fromani> nsoffer: but it was few months ago 17:13 < nsoffer> fromani, when we block iso domain, we get constantly libvirt timeouts 17:14 < nsoffer> I expect that we will get one timoeout, and avoid calling this vm 17:14 < nsoffer> maybe it does not help with this issue? 17:14 < fromani> nsoffer: there is one caveat that maybe could explain things 17:14 < fromani> nsoffer: *only the periodic code* has this kind of protection 17:15 < fromani> nsoffer: if any other piece of code calls libvirt and that call need to access the qemu monitor, we could end in this mess 17:15 < nsoffer> if we stop querying block stats, this can be solved 17:15 < fromani> nsoffer: which is bad, obviously, but there is no obvious solution 17:16 < fromani> nsoffer: not really, we need to stop query any stat that could possibly enter the QEMU monitor 17:16 < fromani> nsoffer: obviously block stats is one big offender, but it is not the only one 17:16 < nsoffer> assuming the monitor is blocked? 17:17 < fromani> nsoffer: yes, stop do any call that enter qemu monitor if we know/suspect the monitor is blocked 17:17 < fromani> nsoffer: we are workarounding a pretty big limitation of libvirt here, any solution is going to be fragile 17:17 < fromani> nsoffer: the proper fix is in the libvirt <=> qemu communication layer 17:17 < nsoffer> I think we need to talk with libvirt/qemu guys about that, how can be get these stats without blocking if one vm is stuck 17:18 < fromani> nsoffer: we had multiple chat in the past 17:18 -!- edwardh1: has quit [Ping timeout: 260 seconds] 17:18 < fromani> nsoffer: I can update about the last status update 17:18 < fromani> nsoffer: the core issue is that qemu monitor protocol is strict request/response with queue size=1 - you issue one request, you wait the response, rinse and repeat forever 17:19 < fromani> nsoffer: so changing this will break compatibility with every QEMU monitor client (or that was the worry) *and* is a lot of work 17:20 < nsoffer> fromani, maybe the solution is stats events from qemu 17:21 < nsoffer> like threshold events 17:21 < fromani> nsoffer: that could be a neat idea 17:21 < nsoffer> qemu stuck - you get no events 17:21 < nsoffer> they have events for reporting vm state 17:22 < nsoffer> back to earth 17:27 -!- jbrooks: has quit [Remote host closed the connection] 17:28 -!- jbrooks (Jason Brooks): has joined #vdsm 17:35 -!- edwardh (purple): has joined #vdsm 17:39 -!- mskrivanek_away is now known as mskrivanek 17:46 -!- leongold: has quit [Ping timeout: 240 seconds] 17:51 -!- mskrivanek is now known as mskrivanek_away 17:51 -!- sleviim1: has quit [Ping timeout: 248 seconds] 18:04 -!- edwardh1 (purple): has joined #vdsm 18:06 -!- edwardh: has quit [Ping timeout: 240 seconds] 18:10 -!- Humble: has quit [Ping timeout: 255 seconds] 18:10 -!- mskrivanek_away is now known as mskrivanek 18:10 -!- edwardh1: has quit [Ping timeout: 252 seconds] 18:17 -!- danken: has quit [Ping timeout: 246 seconds] 18:28 -!- rmohr: has quit [Quit: rmohr] 18:37 -!- irit (purple): has joined #vdsm 18:48 -!- mskrivanek is now known as mskrivanek_away 18:48 -!- irit: has quit [Read error: Connection reset by peer] 18:54 -!- leongold (purple): has joined #vdsm 18:57 -!- erav (purple): has joined #vdsm 19:02 -!- mmirecki (Marcin Mirecki): has joined #vdsm 19:06 -!- erav: has quit [Quit: Leaving.] 19:16 -!- mmirecki: has quit [Ping timeout: 248 seconds] 19:27 -!- tiraboschi_: has left #vdsm ["QUIT :Leaving."] 19:51 -!- erav (purple): has joined #vdsm 19:56 -!- Humble (hchiramm): has joined #vdsm 20:06 -!- irit (purple): has joined #vdsm 20:11 -!- irit: has quit [Read error: No route to host] 20:17 -!- erav: has quit [Quit: Leaving.] 20:18 -!- irit (purple): has joined #vdsm 20:20 -!- irit: has quit [Read error: Connection reset by peer] 21:09 -!- irit (purple): has joined #vdsm 21:13 -!- leongold: has quit [Ping timeout: 248 seconds] 21:21 -!- nsoffer: has quit [Ping timeout: 240 seconds] 21:30 -!- leongold (purple): has joined #vdsm 21:31 -!- irit: has quit [Read error: No route to host] 21:41 -!- erav (purple): has joined #vdsm 21:48 -!- irit (purple): has joined #vdsm 21:51 -!- nsoffer (Nir Soffer): has joined #vdsm 22:04 -!- danken (purple): has joined #vdsm 22:04 -!- mode/#vdsm: by ChanServ 22:08 -!- nsoffer: has quit [Ping timeout: 260 seconds] 22:09 -!- dholler: has quit [Ping timeout: 246 seconds] 22:09 -!- irit: has quit [Read error: No route to host] 22:24 -!- dholler (Dominik Holler): has joined #vdsm 22:31 -!- erav: has quit [Ping timeout: 246 seconds] 22:45 -!- dougsland: has quit [Ping timeout: 240 seconds] 22:50 -!- erav (purple): has joined #vdsm 23:16 -!- dholler: has quit [Ping timeout: 264 seconds] 23:18 -!- nsoffer (Nir Soffer): has joined #vdsm 23:29 -!- dholler (Dominik Holler): has joined #vdsm 23:44 -!- dholler: has quit [Ping timeout: 246 seconds] 23:49 -!- danken: has quit [Ping timeout: 248 seconds] --- Log closed do sep 28 00:00:15 2017