| *** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Quit: Leaving.) | 00:41 | |
| *** florian <florian!~florian@dynamic-002-243-147-169.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 256 seconds) | 00:44 | |
| *** camus <camus!~Instantbi@2409:8a1e:911b:9460:34cb:3e75:456a:4590> has quit IRC (Ping timeout: 240 seconds) | 01:23 | |
| *** camus <camus!~Instantbi@58.246.136.202> has joined #oe | 02:05 | |
| *** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #oe | 02:52 | |
| *** camus <camus!~Instantbi@58.246.136.202> has quit IRC (Ping timeout: 250 seconds) | 03:39 | |
| *** camus1 <camus1!~Instantbi@58.246.136.202> has joined #oe | 03:39 | |
| *** camus1 is now known as camus | 03:42 | |
| *** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Quit: Leaving.) | 04:53 | |
| *** rob_w <rob_w!~bob@host-82-135-31-73.customer.m-online.net> has joined #oe | 07:00 | |
| *** marodz[m] <marodz[m]!~marodzmat@2001:470:69fc:105::1:5f5a> has joined #oe | 07:13 | |
| *** mvlad <mvlad!~mvlad@2a02:2f08:4b12:b100:24d7:51ff:fed6:906d> has joined #oe | 07:43 | |
| *** mckoan|away is now known as mckoan | 07:55 | |
| mckoan | good morning | 07:55 |
|---|---|---|
| jeroen_ | RP: the arch trouble is caused by debian.bbclass, once that is remove most problems are gone.. | 08:02 |
| *** leon-anavi <leon-anavi!~Leon@46.55.231.62> has joined #oe | 08:03 | |
| *** frieder <frieder!~frieder@i4DF677E2.static.tripleplugandplay.com> has joined #oe | 08:04 | |
| *** rob_w <rob_w!~bob@host-82-135-31-73.customer.m-online.net> has quit IRC (Remote host closed the connection) | 08:33 | |
| *** frieder <frieder!~frieder@i4DF677E2.static.tripleplugandplay.com> has quit IRC (Read error: Connection reset by peer) | 08:39 | |
| *** frieder <frieder!~frieder@i4DF677E2.static.tripleplugandplay.com> has joined #oe | 08:42 | |
| *** florian <florian!~florian@port-217-146-132-69.static.as20676.net> has joined #oe | 09:19 | |
| *** jeroen_ <jeroen_!~jeroen@2001:1c01:3bc5:4e00:e791:efe6:bf00:7133> has quit IRC (Quit: Konversation terminated!) | 09:21 | |
| *** frieder <frieder!~frieder@i4DF677E2.static.tripleplugandplay.com> has quit IRC (Ping timeout: 272 seconds) | 09:52 | |
| *** frieder <frieder!~frieder@i4DF677E2.static.tripleplugandplay.com> has joined #oe | 09:54 | |
| *** jeroen_ <jeroen_!~jeroen@2001:1c01:3bc5:4e00:e791:efe6:bf00:7133> has joined #oe | 10:56 | |
| jeroen_ | RP: the arch trouble is mainly caused by debian.bbclass, once you remove that things are mostly fine. | 10:59 |
| RP | jeroen_: fair enough | 11:00 |
| jeroen_ | RP: well I doubt it is fair | 11:02 |
| jeroen_ | RP: but shall we try to improve it? | 11:03 |
| RP | jeroen_: well, it depends how. I still don't fully understand exactly what you're running into or whether my other suggestions helped or not | 11:04 |
| jeroen_ | RP: well the -S helped :) | 11:12 |
| mort | Is there some way to modify the 'rm' command that's used to clear out the dir before building? | 11:39 |
| mort | say, if you have files marked readonly in the build dir so they have to be chmodded before the rm | 11:40 |
| rburton | read only files can be deleted | 12:00 |
| rburton | do you mean read only directories | 12:00 |
| mort | rburton: yeah | 12:24 |
| rburton | don't do that :) | 12:25 |
| mort | well I'm not the one marking the dirs as readonly | 12:26 |
| mort | but the readonly dirs exist, and I need to get bitbake to delete them | 12:27 |
| rburton | assuming they're coming from a tarball, i'd do the chmod in a do_unpack[postfunc] | 13:06 |
| mort | they're coming from the go compiler downloading dependencies during do_compile | 13:13 |
| jeroen_ | mort: I am suprised that is even possible, network access is disable for non fetching tasks nowadays | 13:41 |
| mort | huh | 13:41 |
| mort | maybe it's downloaded during fetch then | 13:41 |
| mort | I don't know how the go bbclass handles go 1.11 modules | 13:42 |
| Saur[m] | jeroen_: That depends on whether your build machine supports disabling network support or not. If it doesn't, it will silently fall back to the old behavior of allowing network support for all tasks. | 13:43 |
| jeroen_ | true, or you can do this https://github.com/victronenergy/bitbake/commit/3dfe84736f315e8179b77dfbad04afe41ab215d4 | 13:45 |
| *** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #oe | 13:59 | |
| *** frieder <frieder!~frieder@i4DF677E2.static.tripleplugandplay.com> has quit IRC (Ping timeout: 256 seconds) | 14:30 | |
| jeroen_ | I am in the illusion that a multiconfig build isn't ordering the tasks on the reference count, not a big problem, but some tasks seem to start really late, libc for a specific machine e.g. | 14:33 |
| jeroen_ | is that correct / is it simply difficult to make a global order or there is there something I can help to improve? | 14:35 |
| smurray | jeroen_: that's probably a question for RP | 15:39 |
| RP | jeroen_: it all depends. If one multiconfig is more heavily referenced it would prefer to build that | 15:45 |
| jeroen_ | RP: I don't understand that, I would expect all libc for all machine to be build first. But that isn't the case. | 15:48 |
| RP | It all depends what you're configuring and asking bitbake to do. I have no idea how you have it configured so I can't really know if it is behaving optimally | 15:51 |
| RP | bitbake has no knowledge of what the tasks are or do though, it just has the taskgraph | 15:51 |
| jeroen_ | RP: ah right, I htink I get it | 15:51 |
| RP | in other words, libc isn't special | 15:51 |
| jeroen_ | RP: can we fix that? | 15:54 |
| RP | jeroen_: you want to hardcoded libc as special in bitbake? No we're not doing that. It wouldn't work with an rtos or something else (mingw?) | 15:55 |
| RP | I have done performance work before and marking some tasks as special really doesn't appear to make much difference in real world tests. That was without multiconfig though, not that I expect it to make much difference | 15:56 |
| rburton | only very special recipes would be interesting (like, it would be useful to get webkit to start building sooner, as it takes forever) | 15:56 |
| rburton | but i'm not in favour of the extra complication in bitbake just to get webkit to build a little earlier | 15:56 |
| RP | rburton: webkit's dependencies also mean it tends to run late :( | 15:57 |
| rburton | yeah you'd have to skew the entire dependency tree | 15:57 |
| mru | an all-knowing build system would presumably schedule tasks based on how long they will take and how much depends on them | 15:57 |
| rburton | in which case you can just 'bitbake webkit; bitbake myimage' | 15:57 |
| rburton | mru: how does it know how long they take? | 15:57 |
| kergoth | also resource availability is a concern, on some hosts that damn final link of webkit takes up a solid chunk of ram of the entire system | 15:57 |
| RP | it would be much better to shorten webkit's dependency tree which would make it then happen earlier naturally | 15:57 |
| mru | sadly, no build system is all-knowing | 15:57 |
| rburton | i've seen systems where webkit is built in a separate step purely because its slow and a resource hog | 15:58 |
| mru | hmm, hints like that could be taken from an earlier run | 15:58 |
| kergoth | mru: it'd be interesting to prototype a build that writes task time and resource usage hints and uses that in subsequent builds to attempt to optimize, but i'd wonder if it'd have much real world effect | 15:58 |
| mru | like profile-guided optimisation in gcc | 15:59 |
| kergoth | :) | 15:59 |
| kergoth | exactly what i was thinking. not sure it'd do much, though, previous attempts to add more weighting mechanisms to teh scheduler didn't have much benefit | 15:59 |
| RP | kergoth: I suspect it wouldn't help as much as you'd think. The build order is nearly entirely determined by dependencies and how long they take rather than resource contention :( | 15:59 |
| rburton | £10 says the difference is negligible | 15:59 |
| kergoth | yep, exactly | 16:00 |
| RP | I was amazed how all my attempts to try and improve this with all kinds of tricks inevitably made it slower! | 16:00 |
| kergoth | time is better spent on keeping builds deterministic and optimizing sstate usage, probably | 16:00 |
| kergoth | hah | 16:00 |
| RP | reducing dependencies is the best thing you can do | 16:00 |
| jeroen_ | RP: indeed, and the best thing to do that is drop debian.bbcclass | 16:01 |
| jeroen_ | RP: we might considerer just doing that renaming for non allarch | 16:02 |
| jeroen_ | ..considerer.. | 16:03 |
| jeroen_ | grr, consider.. | 16:03 |
| RP | jeroen_: We're not just dropping the class, you can disable it, sure | 16:04 |
| jeroen_ | threre is no need afaik to rename allarch packages since they have no libs anyway | 16:04 |
| jeroen_ | RP: understood, but it can drop the rdpeds for allarch | 16:05 |
| jeroen_ | RP: it you do that, python script, php scripts, websites, javascript etc etc is allarch | 16:06 |
| jeroen_ | RP: (well some noise with qa, but we can fix that) | 16:07 |
| RP | jeroen_: that is worth thinking about although I think it is hard to know up front if the allarch code will trigger iirc | 16:08 |
| jeroen_ | RP: well, I will stat doing it for python, likely nodjes etc. | 16:11 |
| jeroen_ | RP: I will let you know if it causes trouble.. | 16:11 |
| jeroen_ | RP: well you have some trouble with the qa trying to run again... It does't really need to, can't hurt either. Sstate will invalidate it thouth, that is annoying. | 16:17 |
| jeroen_ | grrr, it is though obviously. | 16:18 |
| *** jeroen_ <jeroen_!~jeroen@2001:1c01:3bc5:4e00:e791:efe6:bf00:7133> has quit IRC (Quit: Konversation terminated!) | 16:36 | |
| *** florian_kc <florian_kc!~florian@port-217-146-132-69.static.as20676.net> has joined #oe | 16:51 | |
| *** jeroen_ <jeroen_!~jeroen@2001:1c01:3bc5:4e00:e791:efe6:bf00:7133> has joined #oe | 17:08 | |
| *** jeroen_ <jeroen_!~jeroen@2001:1c01:3bc5:4e00:e791:efe6:bf00:7133> has quit IRC (Quit: Konversation terminated!) | 17:21 | |
| *** florian <florian!~florian@port-217-146-132-69.static.as20676.net> has quit IRC (Quit: Ex-Chat) | 17:32 | |
| *** florian_kc <florian_kc!~florian@port-217-146-132-69.static.as20676.net> has quit IRC (Ping timeout: 256 seconds) | 17:35 | |
| *** mckoan is now known as mckoan|away | 17:37 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has joined #oe | 18:37 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 256 seconds) | 19:09 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has joined #oe | 19:36 | |
| *** camus <camus!~Instantbi@58.246.136.202> has quit IRC (Ping timeout: 256 seconds) | 19:43 | |
| *** camus <camus!~Instantbi@58.246.136.202> has joined #oe | 19:43 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 240 seconds) | 19:57 | |
| *** dev1990 <dev1990!~dev@dynamic-78-8-236-92.ssp.dialog.net.pl> has joined #oe | 20:17 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has joined #oe | 20:49 | |
| *** mvlad <mvlad!~mvlad@2a02:2f08:4b12:b100:24d7:51ff:fed6:906d> has quit IRC (Remote host closed the connection) | 20:57 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 272 seconds) | 21:09 | |
| *** LetoThe2nd <LetoThe2nd!~Josef_Hol@ec2-52-29-15-71.eu-central-1.compute.amazonaws.com> has quit IRC (Quit: WeeChat 3.4) | 21:12 | |
| *** camus <camus!~Instantbi@58.246.136.202> has quit IRC (Remote host closed the connection) | 21:29 | |
| *** camus <camus!~Instantbi@58.246.136.202> has joined #oe | 21:30 | |
| *** leon-anavi <leon-anavi!~Leon@46.55.231.62> has quit IRC (Quit: Leaving) | 21:32 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has joined #oe | 21:34 | |
| *** otavio <otavio!~otavio@201-3-135-79.user3p.brasiltelecom.net.br> has quit IRC (Remote host closed the connection) | 21:46 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 256 seconds) | 21:50 | |
| *** otavio <otavio!~otavio@201-3-135-79.paemt705.dsl.brasiltelecom.net.br> has joined #oe | 21:53 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has joined #oe | 22:40 | |
| *** florian_kc <florian_kc!~florian@dynamic-002-243-109-007.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 240 seconds) | 23:24 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!