Tuesday, 2022-08-02

*** brazuca <brazuca!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has quit IRC (Ping timeout: 252 seconds)00:07
*** GNUmoon2 <GNUmoon2!~GNUmoon@gateway/tor-sasl/gnumoon> has quit IRC (Ping timeout: 268 seconds)00:07
*** GNUmoon2 <GNUmoon2!~GNUmoon@gateway/tor-sasl/gnumoon> has joined #yocto00:08
*** Guest1422 <Guest1422!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has joined #yocto00:12
*** Guest1422 is now known as brazuca00:12
*** brazuca <brazuca!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has quit IRC (Ping timeout: 252 seconds)00:20
*** GNUmoon2 <GNUmoon2!~GNUmoon@gateway/tor-sasl/gnumoon> has quit IRC (Remote host closed the connection)00:25
*** GNUmoon2 <GNUmoon2!~GNUmoon@gateway/tor-sasl/gnumoon> has joined #yocto00:25
*** Guest1410 <Guest1410!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has joined #yocto00:28
*** Guest1410 is now known as brazuca00:28
*** ferlzc <ferlzc!uid563760@id-563760.hampstead.irccloud.com> has joined #yocto00:47
*** xmn <xmn!~xmn@cpe-72-225-198-203.nyc.res.rr.com> has quit IRC (Ping timeout: 252 seconds)00:56
*** xmn <xmn!~xmn@cpe-72-225-198-203.nyc.res.rr.com> has joined #yocto00:59
*** rfs613- is now known as rfs61301:19
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #yocto01:29
*** Maxxed <Maxxed!~Maxxed@nrgt.net> has quit IRC (Ping timeout: 244 seconds)01:29
*** rber|res <rber|res!~rber|res@91-114-222-45.adsl.highway.telekom.at> has joined #yocto01:32
*** xenador77 <xenador77!~xenador77@user/xenador77> has joined #yocto01:33
*** RobertBerger <RobertBerger!~rber|res@91-114-222-45.adsl.highway.telekom.at> has quit IRC (Ping timeout: 252 seconds)01:34
*** starblue <starblue!~juergen@dslb-094-221-186-098.094.221.pools.vodafone-ip.de> has quit IRC (Ping timeout: 252 seconds)01:54
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 240 seconds)01:54
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto01:54
*** starblue <starblue!~juergen@dslb-094-220-119-106.094.220.pools.vodafone-ip.de> has joined #yocto01:56
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 240 seconds)01:58
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto01:59
*** seninha <seninha!~seninha@user/seninha> has quit IRC (Remote host closed the connection)03:12
*** florian <florian!~florian@dynamic-002-244-019-190.2.244.pool.telefonica.de> has quit IRC (Ping timeout: 268 seconds)03:26
*** GNUmoon2 <GNUmoon2!~GNUmoon@gateway/tor-sasl/gnumoon> has quit IRC (Read error: Connection reset by peer)03:29
*** GNUmoon2 <GNUmoon2!~GNUmoon@gateway/tor-sasl/gnumoon> has joined #yocto03:30
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Quit: Leaving.)03:32
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has joined #yocto03:39
*** pgowda_ <pgowda_!uid516182@id-516182.ilkley.irccloud.com> has joined #yocto04:10
*** amitk <amitk!~amit@103.59.74.120> has joined #yocto04:27
*** brazuca <brazuca!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has quit IRC (Ping timeout: 252 seconds)05:46
*** goliath <goliath!~goliath@user/goliath> has joined #yocto05:47
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto05:49
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 240 seconds)05:49
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto05:49
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 268 seconds)05:54
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto05:59
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Quit: alessioigor)06:29
*** mvlad <mvlad!~mvlad@2a02:2f08:4a10:7900:24d7:51ff:fed6:906d> has joined #yocto06:36
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Quit: SIGSEGV)06:50
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has joined #yocto06:51
*** starblue <starblue!~juergen@dslb-094-220-119-106.094.220.pools.vodafone-ip.de> has quit IRC (Quit: WeeChat 3.0)06:52
*** manuel1985 <manuel1985!~manuel198@62.99.131.178> has joined #yocto07:01
*** gsalazar <gsalazar!~gsalazar@132.120.90.149.rev.vodafone.pt> has quit IRC (Quit: Leaving)07:08
*** gsalazar <gsalazar!~gsalazar@132.120.90.149.rev.vodafone.pt> has joined #yocto07:08
*** ptsneves <ptsneves!~Thunderbi@031011128142.dynamic-3-poz-k-0-2-0.vectranet.pl> has joined #yocto07:24
qschulzhalstead: ok thanks for looking this up!07:29
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has quit IRC (Ping timeout: 252 seconds)07:29
*** Guest53 <Guest53!~Guest53@62.67.214.101> has joined #yocto07:30
Guest53https://stackoverflow.com/questions/24769944/where-are-bitbake-python-functions-documented07:31
Guest53people ask for it07:31
Guest53it used to be there in 2.3 https://docs.yoctoproject.org/2.3/bitbake-user-manual/bitbake-user-manual.html#bitbake-style-python-functions-versus-python-functions07:31
Guest53Well, it is there https://docs.yoctoproject.org/bitbake/2.0/singleindex.html07:33
mborzeckidoes devtool work with multiconfig?  the commands seem to interpret recipe name literally07:38
*** wkawka <wkawka!~wkawka@84-10-27-202.static.chello.pl> has joined #yocto07:40
LetoThe2ndmborzecki: good question, i wouldn't bet on it.07:40
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has joined #yocto07:43
mborzeckiLetoThe2nd: yeah, i was originally using dunfell which is quite old but already has multiconfigs, but ti's the same on kirkstone, i'm guessing master will be identical in that regard07:43
*** goliath <goliath!~goliath@user/goliath> has joined #yocto07:44
LetoThe2ndmborzecki: yes, i haven't noticed any substantial patches to devtool lately.07:45
qschulzGuest53: https://docs.yoctoproject.org/bitbake/bitbake-user-manual/bitbake-user-manual-metadata.html#bitbake-style-python-functions-versus-python-functions07:45
qschulzbut yeah, we should autogenerate doc from the docstring of libs07:45
mborzeckiok, maybe something I can look into07:45
LetoThe2ndmborzecki: would be much appreciated!07:48
*** murych <murych!~tmayzenbe@91.193.178.153> has joined #yocto07:55
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has quit IRC (Ping timeout: 240 seconds)08:03
Guest53is devtool part of Yocto effort, not OE?08:08
rburtonThere’s very little meaningful difference. It’s in the oe-core repository.08:10
*** td31 <td31!~td@131.228.2.20> has joined #yocto08:13
td31Hi,08:14
td31why is "${includedir}/python${PYTHON_MAJMIN}/pyconfig*.h" included in the python3-core package? Do we need the header for anything on target?08:14
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has joined #yocto08:18
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Ping timeout: 268 seconds)08:22
*** goliath <goliath!~goliath@user/goliath> has joined #yocto08:24
*** rsalveti <rsalveti!uid117878@id-117878.uxbridge.irccloud.com> has quit IRC (Quit: Connection closed for inactivity)08:32
*** jclsn <jclsn!~jclsn@2a04:4540:650a:9e00:edb:7f07:802b:71de> has joined #yocto08:36
*** vladest <vladest!~Thunderbi@adsl-89-217-204-83.adslplus.ch> has joined #yocto09:06
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has quit IRC (Ping timeout: 264 seconds)09:29
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has joined #yocto09:32
kayterina[m]hello, is archiver.bbclass used by default somewhere in poky or it has to be included from a recipe? I grep'ed and I did not find any "include archiver" ot in the local.conf of the project09:47
LetoThe2ndkayterina[m]: you need to include it.09:49
LetoThe2ndkayterina[m]:09:52
LetoThe2ndCouldn't find partition mmc 2:2y09:52
LetoThe2ndmeh09:53
LetoThe2ndhttps://docs.yoctoproject.org/dev-manual/common-tasks.html#maintaining-open-source-license-compliance-during-your-product-s-lifecycle09:53
kayterina[m]yes I found it after I asked.09:53
kayterina[m]A, LetoThe2nd I have homemade tsipouro from Epirus. Too bad you cant taste it from here.09:53
*** xenador77 <xenador77!~xenador77@user/xenador77> has quit IRC (Remote host closed the connection)09:55
*** xenador77 <xenador77!~xenador77@user/xenador77> has joined #yocto09:56
*** xenador77 <xenador77!~xenador77@user/xenador77> has quit IRC (Remote host closed the connection)10:02
*** xenador77 <xenador77!~xenador77@user/xenador77> has joined #yocto10:02
LetoThe2ndkayterina[m]: how comes you think of Epirus right now?10:03
LetoThe2nd;-)10:03
kayterina[m]A friend is from there and her grandmother made tsipouro, she gave my a bottle  and I left it in my bag, I have it here at the office.10:05
LetoThe2ndkayterina[m]: hehe. I've actually been to Epirus a few times.10:06
kayterina[m]which village?10:06
LetoThe2ndsivota10:06
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)10:07
kayterina[m]very popular. It has beach, it does not count!10:07
LetoThe2nddoes it at least count a little if pointing out that we were at a small family hotel a few km outside? ;-)10:09
kayterina[m]yes, I will give you that. If you visit again go to metsovo, they have exceptional cheese.(ok for greek standards, we are not Gouda)10:10
LetoThe2nd:-)10:10
LetoThe2ndgood keyword though, food. heading out for lunch!10:11
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 240 seconds)10:13
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto10:18
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto10:22
*** jclsn <jclsn!~jclsn@2a04:4540:650a:9e00:edb:7f07:802b:71de> has quit IRC (Quit: WeeChat 3.5)10:28
*** jclsn <jclsn!~jclsn@2a04:4540:650a:9e00:edb:7f07:802b:71de> has joined #yocto10:29
*** xenador77 <xenador77!~xenador77@user/xenador77> has quit IRC (Remote host closed the connection)10:29
*** wkawka <wkawka!~wkawka@84-10-27-202.static.chello.pl> has quit IRC (Quit: Client closed)10:33
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has quit IRC (Ping timeout: 268 seconds)10:50
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has joined #yocto10:53
*** Guest53 <Guest53!~Guest53@62.67.214.101> has quit IRC (Quit: Client closed)10:53
*** ptsneves <ptsneves!~Thunderbi@031011128142.dynamic-3-poz-k-0-2-0.vectranet.pl> has quit IRC (Ping timeout: 240 seconds)11:03
*** seninha <seninha!~seninha@user/seninha> has joined #yocto11:08
*** leon-anavi <leon-anavi!~Leon@46.55.231.62> has joined #yocto11:31
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)11:37
*** td31 <td31!~td@131.228.2.20> has quit IRC (Quit: Client closed)11:51
*** Guest14 <Guest14!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has joined #yocto12:01
*** Guest14 is now known as brazuca12:01
*** brazuca <brazuca!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has quit IRC (Quit: Client closed)12:10
*** Guest14 <Guest14!~Guest14@2804:7f4:3590:6971:3045:4501:957f:c55d> has joined #yocto12:25
*** Guest14 is now known as brazuca12:25
*** ptsneves <ptsneves!~Thunderbi@85-128-83-172.static.ip.netia.com.pl> has joined #yocto12:28
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)12:48
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto12:48
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 268 seconds)12:54
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto12:54
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto12:59
JPEWRP: Is there a better way to do the own-mirrors thing that I'm missing?13:21
JPEW(or, I can move it to our own internal class if you don't want the overhead in OE-core)13:22
RPJPEW: I couldn't think of a better way. I just worry every time we add more anon python and wish we had a better way :/13:23
RPparticularly anon python that has to run for every recipe13:23
JPEWRP: Ya, I was a little worried about that. Are there ideas on ways that could be done to do it better?13:24
RPJPEW: I wondered if we should add a config level anon python13:24
JPEWLike in .conf files and part of the basehash?13:24
JPEWIs that the right term?13:25
RPJPEW: we "pre parse" the base configuration and then parse the recipes on top of a copy13:25
JPEWYa; is that the same as the basehash or is there a basehash per-recipe?13:25
Saur[m]Isn't there a risk that will be confusing if people expect the anon python from the config files to actually be executed per recipe?13:26
RPwe could run anon code at that point, with the caveat that changes made by the recipe specific bits would have no effect13:26
RPSaur[m]: it would have to be marked differently and it would risk confusing people13:26
RPJPEW: basehash is quite different13:26
JPEWPerhaps we could "taint" the variables and warn if they are modified in the recipe13:26
JPEWGot it13:26
*** hcg <hcg!~hcg@185.210.97.85> has quit IRC (Quit: Client closed)13:26
RPJPEW: that is a hash at the end of parsing of the recipe before the other taskgraph is accounted for13:26
JPEWRP: Right, got it13:27
JPEWRP: I though maybe moving it to a library function that gets called, but it's so short that didn't seem like it would help much13:33
*** hcg <hcg!~hcg@185.210.97.85> has joined #yocto13:40
LetoThe2ndwhats the build-ability on RHEL these days? specifically RHEL 8... if I read correctly that should be Fedora 28. Anybody experience with dunfell and/or kirkstone?13:51
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #yocto13:51
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 268 seconds)13:54
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto13:54
*** jclsn <jclsn!~jclsn@2a04:4540:650a:9e00:edb:7f07:802b:71de> has quit IRC (Ping timeout: 268 seconds)13:58
*** jclsn <jclsn!~jclsn@149.224.66.9.dynamic-pppoe.dt.ipv4.wtnet.de> has joined #yocto13:58
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 268 seconds)13:59
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto13:59
RPJPEW: right, I don't think a library function would buy much here14:01
RPLetoThe2nd: alma8 works14:01
RPLetoThe2nd: centos8 also did work14:01
*** jclsn <jclsn!~jclsn@149.224.66.9.dynamic-pppoe.dt.ipv4.wtnet.de> has quit IRC (Client Quit)14:02
qschulzkanavin: aren't go programs statically compiled? in that case, I think there could be an alternative to the go version question on the ML in actually using multiconfig for that?14:07
qschulzcreate the binary with a different conf file for different go versions and then include this statically linked binary into the final image, which uses a different go compiler?14:08
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)14:13
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto14:14
*** agupta1_ <agupta1_!~agupta1@207.107.110.122> has joined #yocto14:18
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 240 seconds)14:18
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto14:19
*** vladest1 <vladest1!~Thunderbi@2001:1715:9d9c:c530:b409:3bd7:80ce:b629> has joined #yocto14:25
*** vladest <vladest!~Thunderbi@adsl-89-217-204-83.adslplus.ch> has quit IRC (Ping timeout: 240 seconds)14:27
*** vladest1 is now known as vladest14:27
*** zeddiii is now known as zeddii14:29
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 268 seconds)14:29
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto14:30
*** rsalveti <rsalveti!uid117878@id-117878.uxbridge.irccloud.com> has joined #yocto14:33
*** tomzy_0 <tomzy_0!~tomzy_0@84-10-27-202.static.chello.pl> has joined #yocto14:38
*** Estrella_ <Estrella_!~quassel@192-063-174-177.res.spectrum.com> has joined #yocto14:41
*** Estrella____ <Estrella____!~quassel@134.238.170.19> has joined #yocto14:41
*** manuel_ <manuel_!~manuel198@62.99.131.178> has joined #yocto14:42
*** Estrella___ <Estrella___!~quassel@192-063-174-177.res.spectrum.com> has quit IRC (Ping timeout: 245 seconds)14:43
*** Estrella__ <Estrella__!~quassel@192-063-174-177.res.spectrum.com> has quit IRC (Ping timeout: 272 seconds)14:43
*** manuel1985 <manuel1985!~manuel198@62.99.131.178> has quit IRC (Ping timeout: 240 seconds)14:45
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Quit: SIGSEGV)14:47
*** gsalazar <gsalazar!~gsalazar@132.120.90.149.rev.vodafone.pt> has quit IRC (Quit: Leaving)14:47
*** gsalazar <gsalazar!~gsalazar@132.120.90.149.rev.vodafone.pt> has joined #yocto14:47
*** manuel_ <manuel_!~manuel198@62.99.131.178> has quit IRC (Ping timeout: 268 seconds)14:48
*** berton[m] <berton[m]!~berton@2001:470:69fc:105::ce36> has joined #yocto14:54
LetoThe2ndRP: sorry, didn't notice the reply. so building dunfell should be fine?14:59
*** pgowda_ <pgowda_!uid516182@id-516182.ilkley.irccloud.com> has quit IRC (Quit: Connection closed for inactivity)14:59
RPLetoThe2nd: I'd think so15:01
LetoThe2ndRP: kirkstone?15:02
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)15:08
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto15:09
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 245 seconds)15:13
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto15:14
*** jsandman <jsandman!~jsandman@95.179.203.88> has quit IRC (Quit: Ping timeout (120 seconds))15:18
*** jsandman <jsandman!~jsandman@95.179.203.88> has joined #yocto15:18
RPLetoThe2nd: should be fine15:23
LetoThe2ndRP: kaythanks!15:27
*** gsalazar <gsalazar!~gsalazar@132.120.90.149.rev.vodafone.pt> has quit IRC (Ping timeout: 240 seconds)15:28
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has joined #yocto15:29
kanavinqschulz, I think that's more complicated than just figuring out how to use a single go compiler15:29
*** yannholo <yannholo!~yannholo@fs-141-0-205-41.fullsave.info> has joined #yocto15:29
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 268 seconds)15:39
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto15:39
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 252 seconds)15:43
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto15:44
*** yannholo_ <yannholo_!~yannholo@fs-141-0-205-41.fullsave.info> has joined #yocto15:46
*** lexano <lexano!~lexano@174.119.69.134> has quit IRC (Remote host closed the connection)15:48
*** yannholo <yannholo!~yannholo@fs-141-0-205-41.fullsave.info> has quit IRC (Ping timeout: 268 seconds)15:49
yannholo_Hello, I have a file in my image "/lib/firmware/.../something.conf" I want to change it, when searching the recipe it came from with "oe-pkgdata-util find-path /lib/firmware/.../something.conf" I get an error "Unable to find any package producing path..." Is there another way to find the source recipe ?15:55
yannholo_(I know the sources it comes from and even have my patch ready, but am not finding the recipe)15:56
*** gsalazar <gsalazar!~gsalazar@213.58.201.38> has joined #yocto16:02
*** zpfvo <zpfvo!~fvo@i59F5CF5B.versanet.de> has quit IRC (Ping timeout: 268 seconds)16:09
*** gsalazar <gsalazar!~gsalazar@213.58.201.38> has quit IRC (Ping timeout: 240 seconds)16:09
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has quit IRC (Quit: Leaving)16:16
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has joined #yocto16:20
*** agupta1_ <agupta1_!~agupta1@207.107.110.122> has quit IRC (Ping timeout: 240 seconds)16:22
*** dev1990 <dev1990!~dev@159-205-91-89.adsl.inetia.pl> has quit IRC (Quit: Konversation terminated!)16:32
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has quit IRC (Quit: Leaving)16:34
*** gsalazar <gsalazar!~gsalazar@132.120.90.149.rev.vodafone.pt> has joined #yocto16:40
*** agupta1_ <agupta1_!~agupta1@207.107.110.122> has joined #yocto16:49
*** xmn <xmn!~xmn@cpe-72-225-198-203.nyc.res.rr.com> has quit IRC (Ping timeout: 268 seconds)16:56
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 268 seconds)17:01
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has joined #yocto17:02
vmesonJaMa: Can you explain what happened when you were testing the /proc/pressure regulation either here, in a email  or in a defect ?17:08
vmesonMy take so far is that you had two chromium builds going before and they always worked  then you added /proc/pressure regulation and the same workflow resulted in an OOM, right?17:09
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has quit IRC (Quit: Leaving)17:09
vmesonIf so what pressure regulation values did you pick and why did you pick them?17:09
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has joined #yocto17:11
*** denisoft81 <denisoft81!~denisoft8@host-79-31-20-131.retail.telecomitalia.it> has quit IRC (Client Quit)17:12
vmesonFinally, I don't see how bitbake could avoid having two chromium builds running at once since it will eventually need to start at least one task given the current scheduler design that says that at least one task must be running.17:13
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has joined #yocto17:14
*** lexano <lexano!~lexano@174.119.69.134> has joined #yocto17:19
yannholo_@yannholo_ I managed to make it work, the SRC_URI of the recipe used the destsuffix and name parameter, maybe that breaks oe-pkgdata-util...17:21
*** yannholo_ <yannholo_!~yannholo@fs-141-0-205-41.fullsave.info> has quit IRC (Remote host closed the connection)17:25
JaMavmeson: no, OOMK wasn't caused by /proc/pressure regulation, it was already happening, I was just asking if there is a technical reason not to track memory pressure (to avoid OOMK or at least lower the probability), if it was just omitted because it didn't look interesting on your builds, then I might add it to buildstats to see what it records in my builds17:35
JaMavmeson: in https://github.com/shr-project/test-oe-build-time I have bunch of results where bitbake tasks were running when the builder was already using a lot of swap, if that's "easy" to detect from memory pressure before it gets really bad, than additional regulation on memory pressure might help17:36
vmesonJaMa: ok, agupta1_ is going to add memory regulation as well so maybe wait a day or two since it should be simple enough to add.17:36
vmesonJaMa: I think I told agupta1_ that no one would ever push their build machine so a hard that there would be lots of swapping!  There goes that assertion!17:37
JaMavmeson: I haven't pushed the bootcharts with pressure collection enabled in buildstats yet, because my last build failed (when building rust-llvm-native from dunfell), but I can push the partial results if you want to see my cpu/io pressure17:37
JaMahehe17:38
vmesonJaMa: sure, we'll take a look.17:38
JaMawith nodejs/chromium/qtwebengine/qtwebkit/webkit-gtk in the mix it's difficult to find balance between PARALLEL_MAKE/BB_NUMBER_THREADS so even with just 8 BB_NUMBER_THREADS you can easily get to swap when the BIG do_compile align badly and run at the same time17:39
JaMawith pressure regulation it might be easier to tell bitbake to go ham and when it starts to go badly to backoff a bit17:40
vmesonJaMa: Yep, the plan is to teach make/ninja about pressure regulation and other metrics to be able to walk the line between good use of the system and overloading the box.17:41
JaMaand https://gitlab.eclipse.org/eclipse/oniro-core/oniro/-/merge_requests/196/diffs looks great to me, because it will allow to backoff even after 4 unfortuantely BIG do_compile tasks already started17:41
JaMaand the RAM might be a bit unpredictable if someone happens to use the workstation for builds as well as regular work (e.g. 30G RAM in chrome tabs)17:43
JaMaOOMK was sometimes kind enough to kill chrome before g++, but sometimes it kills systemd or networking which is terrible :)17:45
JaMaPARALLEL_MAKE:pn-qtwebengine = "-j 40" + PARALLEL_MAKE:pn-chromium = "-j 40" + PARALLEL_MAKE:pn-webruntime = "-j 40" (instead of my default -j 70) helps a lot with OOMK, but also looses a bit when chromium is the only recipe I've changed and is rebuilt without any browser eating host's ram17:47
*** murych <murych!~tmayzenbe@91.193.178.153> has quit IRC (Quit: Konversation terminated!)17:50
vmesonJaMa: have you played with PARALLEL_MAKE:pn-qtwebengine = "-j 40 -l 40"  -- That way if you only have one build, you get 40  compile job but when there are more things going on, you keep the system load averaging at 40.17:50
vmesonWe use that on the autobuilder: https://git.yoctoproject.org/yocto-autobuilder-helper/commit/?id=5c5fc7bcd221427d34bbac80c9bad315fb6de4df17:51
vmesonif anyone has played with the job server feature of Gnu Make, that would be interesting to hear about. https://www.gnu.org/software/make/manual/html_node/Job-Slots.html17:52
kergothrichard had an old patch to make bitbake act as a make jobserver. not sure it ever got past prototype though17:53
vmesonI'm not sure how we'd share one job server between multiple builds (different users?) but I guess it's possible.17:53
vmesonkergoth: richard has an old patch for just about everything it seems! Let's see if he wanders by and digs it up before I ask him about it later this week.17:54
*** seninha <seninha!~seninha@user/seninha> has quit IRC (Ping timeout: 252 seconds)17:57
JaMavmeson: not yet, but looks like I really should try it (and not only for qtwebengine, but in default PARALLEL_MAKE I guess)17:58
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 252 seconds)18:01
vmesonJaMa: cool.18:02
*** xmn <xmn!~xmn@cpe-72-225-198-203.nyc.res.rr.com> has joined #yocto18:13
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has joined #yocto18:13
JaMavmeson: here are my buildstats with 8 and 64 bitbake threads https://raw.githubusercontent.com/shr-project/test-oe-build-time/results/threadripper-3970x-128gb-gentoo-kirkstone-2022-07/5-build-8-bb-threads.bootchart.svg https://raw.githubusercontent.com/shr-project/test-oe-build-time/results/threadripper-3970x-128gb-gentoo-kirkstone-2022-07/4-build-all-cores.bootchart.svg I guess you need to read the .log18:32
JaMafiles to find right BB_PRESSURE_MAX_* numbers, right? I don't see the scale in the graph (even when viewing interactively not in .svg export)18:32
*** goliath <goliath!~goliath@user/goliath> has joined #yocto18:35
*** starblue <starblue!~juergen@dslb-094-220-119-106.094.220.pools.vodafone-ip.de> has joined #yocto18:37
*** vladest <vladest!~Thunderbi@2001:1715:9d9c:c530:b409:3bd7:80ce:b629> has quit IRC (Ping timeout: 240 seconds)18:42
JaMavmeson: agupta1_: I've a patch for rendering memory pressure as well, testing it now18:55
vmesonJaMa: buildstats logging or pressure regulation or both?18:58
JaMalogging was already there, I've just added the graph to pybootchartgui to more easily see the values I have19:00
vmesonJaMa: ah right. The 6 GB swap max scale is nuts! Why can't you run the builds seriallly?19:01
*** Estrella__ <Estrella__!~quassel@192-063-174-177.res.spectrum.com> has joined #yocto19:01
*** BWhitten <BWhitten!~BWhitten@128.224.143.150.dyn.plus.net> has joined #yocto19:03
JaMavmeson: this is single build19:03
vmesonand 64 threads is ~ 32 GB swap - buddy, here's a dime, go buy some more RAM ! ;-)19:04
JaMavmeson: highest mem pressure i the logs is: 77.2 54.25 21.04 7703319:04
JaMavmeson: well 128G is kind of safe limit for TRX4019:04
vmesonhttps://dilbert.com/strip/1995-06-24  -- inflation s/nickel/dime/19:04
*** Estrella____ <Estrella____!~quassel@134.238.170.19> has quit IRC (Ping timeout: 268 seconds)19:05
vmesonJaMa: yeah, let me look at the buildchart again...19:05
JaMavmeson: with 8 modules I most likely couldn't use 3200Mhz ram and QVL for 8 modules is _very_ short19:05
JaMaand even with just 4 32G modules @2666 I'm now seeing some single bit errors in memtest86 :/19:06
JaMaupgrading from 3970X to 3995WX would be nice, but I'm not paid that well :)19:07
JaMavmeson: you can try to run it on your builder as well to see what breaks, just checkout langdale branch and run test.sh19:08
vmesonJaMa: agupta1_ has the memory pressure regulation done but not tested...19:11
vmesonWe should probably try your build... what a monster config!!19:12
JaMavmeson: I've refreshed the bootcharts in repo to show mem pressure and sent the pybootchart patch to oe-core19:13
vmesonJaMa:  kk. reloaded:  the bust of swap  pressure is rather short....19:15
vmesonJaMa: it would be interesting a buildchart if you set the max cpu pressure to say 500-2000 depend on the numbers in your logs.19:17
JaMayes and in the example I was looking at it was already when chromium-x11, webkit-gtk, firefox do_compile were running (so too late not to start them)19:18
*** florian_kc <florian_kc!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has joined #yocto19:18
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)19:19
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto19:19
JaMait could ease a bit by not starting anything more, but still these 3 will be able to trigger OOMK even when they continue to run only these 319:19
vmesonJaMa: yeah with -j 40, you'd still have three big jobs start, maybe a bit later than usual, then once you start seeing cpu pressure, it's sustained so there shouldn't be another job started for a while.19:20
vmesonJaMa: hmmm, I guess you have to try it out so see if it helps. When the big jobs are linking, there's going to be more memory needed... so we'll have to think about how to handle that.19:21
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 252 seconds)19:22
JaMayes, I plan to run it few more times with various settings, it will take couple days to finish19:22
JaMamost of my bigger projects use ninja, so maybe the -l you mentioned will do most of the work19:23
vmesonour 192 core system has 256 GB RAM so maybe better balanced. Occasionally someone messes up and it OOMs or the scheduler hangs but it's so rare that we haven't figure out how to prevent it let along who to blame! ;-)19:23
JaMaif not will wait for agherzan to submit his cmake changes and test those as well19:23
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 252 seconds)19:23
JaMait has less ram per core than mine, you're just not hammering it enough :)19:24
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto19:25
*** angrysiamese <angrysiamese!~erik@50.207.9.18> has left #yocto (Leaving)19:28
vmesonJaMa: heh. Do you have any logs showing what was happening when the memory pressure spiked at 4950 or so in : https://raw.githubusercontent.com/shr-project/test-oe-build-time/results/threadripper-3970x-128gb-gentoo-kirkstone-2022-07/4-build-all-cores.bootchart.svg19:30
kergothI ended up adding naive heuristic-based scaling down of jobs/threads based on mem-per-core for our distro, not ideal, but better than nothing19:31
kergothyawn19:31
*** Ram-Z <Ram-Z!~Ram-Z@li1814-254.members.linode.com> has quit IRC (Ping timeout: 252 seconds)19:38
JaMavmeson: like bitbake cooker log? I can also find some graphs in grafana from that time, but not sure what else it would show19:39
*** Ram-Z <Ram-Z!~Ram-Z@li1814-254.members.linode.com> has joined #yocto19:41
vmesonJaMa: I'm wondering if the log.do_compile files would show when the big apps were being linked.19:43
JaMaah log.do_compile files are already gone19:44
JaMahttps://raw.githubusercontent.com/shr-project/test-oe-build-time/results/threadripper-3970x-128gb-gentoo-kirkstone-2022-03/luneos-dev-emulator-appliance-j70-bb8-with-webruntime-j40.png shows how closely I get to 128G in regular image build of LuneOS (and this is after reducing webruntime to -j 40)19:44
*** Ram-Z <Ram-Z!~Ram-Z@li1814-254.members.linode.com> has quit IRC (Ping timeout: 240 seconds)19:47
JaMavmeson: https://raw.githubusercontent.com/shr-project/test-oe-build-time/be96ba3722b995bf61e10aa71d7fc7654a5a61c0/threadripper-3970x-128gb-gentoo-kirkstone-2022-07/4-build-all-cores.grafana.png19:49
JaMasorry wrong file19:49
JaMavmeson: https://raw.githubusercontent.com/shr-project/test-oe-build-time/4a4ef91fd5a52b7314ebaa8fdfcb029fe4569c26/threadripper-3970x-128gb-gentoo-kirkstone-2022-07/4-build-all-cores.grafana.png19:51
JaMathis shows the 40GB swap spike at 02:1019:52
vmesonJaMa: it's hard to say what's causing the spike, based on the Graphana data. Can you try a run with some value of cpu regulation, say 1000,  and leave bitbake's max tasks at 64?19:58
*** seninha <seninha!~seninha@user/seninha> has joined #yocto19:58
JaMavmeson: yes, will do in couple days (tonight want to re-run dunfell build), then will go back to langdale testing20:00
vmesonJaMa: ok, Thursday morning is when we usually go over build regulation things. 9 AM ET - does that work for you?20:00
JaMawill try to attend and get the data before that20:02
JaMatomorrow might receive new laptop, maybe I'll be able to let my workstation do the benchmark when setting the laptop20:03
*** davidinux <davidinux!~davidinux@81.22.36.18> has quit IRC (Ping timeout: 245 seconds)20:04
vmesonJaMa: super, thanks.20:06
JaMavmeson: is it the same zoom meeting as Weekly Triage just 1,5 hour earlier?20:07
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 268 seconds)20:09
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Quit: SIGSEGV)20:13
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto20:14
*** voyqsv <voyqsv!~voyqsv@user/ako> has joined #yocto20:17
*** florian_kc <florian_kc!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has quit IRC (Quit: Ex-Chat)20:18
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has joined #yocto20:20
*** voyqsv <voyqsv!~voyqsv@user/ako> has quit IRC (Remote host closed the connection)20:23
vmesonJaMa: yep20:32
vmesonJaMa: err, no... I'll send you an invite.20:33
*** xenador77 <xenador77!~xenador77@user/xenador77> has joined #yocto20:47
*** manuel1985 <manuel1985!~manuel198@2a02:1748:dd5c:f290:c5b2:fdff:b718:9edf> has joined #yocto20:52
*** seninha <seninha!~seninha@user/seninha> has quit IRC (Remote host closed the connection)20:55
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)20:58
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto20:59
*** leon-anavi <leon-anavi!~Leon@46.55.231.62> has quit IRC (Remote host closed the connection)20:59
*** goliath <goliath!~goliath@user/goliath> has joined #yocto21:01
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 240 seconds)21:03
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto21:03
*** xenador77 <xenador77!~xenador77@user/xenador77> has quit IRC (Remote host closed the connection)21:10
*** xenador77 <xenador77!~xenador77@user/xenador77> has joined #yocto21:14
*** alimon <alimon!~alimon@2806:10b7:3:a0b9:2c32:cfff:fe8e:de1f> has quit IRC (Ping timeout: 272 seconds)21:22
*** mvlad <mvlad!~mvlad@2a02:2f08:4a10:7900:24d7:51ff:fed6:906d> has quit IRC (Remote host closed the connection)21:25
*** Estrella_ <Estrella_!~quassel@192-063-174-177.res.spectrum.com> has quit IRC (Remote host closed the connection)21:27
*** Estrella_ <Estrella_!~quassel@192-063-174-177.res.spectrum.com> has joined #yocto21:27
*** BWhitten <BWhitten!~BWhitten@128.224.143.150.dyn.plus.net> has quit IRC (Remote host closed the connection)21:30
*** erbo <erbo!~erik@linode.unixshell.se> has quit IRC (Ping timeout: 240 seconds)21:30
*** tomzy_0 <tomzy_0!~tomzy_0@84-10-27-202.static.chello.pl> has quit IRC (Ping timeout: 252 seconds)21:30
*** alimon <alimon!~alimon@2806:10b7:3:89c0:2c32:cfff:fe8e:de1f> has joined #yocto21:35
*** willo <willo!~quassel@60-241-162-73.static.tpgi.com.au> has quit IRC (*.net *.split)21:38
*** willo <willo!~quassel@60-241-162-73.static.tpgi.com.au> has joined #yocto21:39
*** manuel1985 <manuel1985!~manuel198@2a02:1748:dd5c:f290:c5b2:fdff:b718:9edf> has quit IRC (Ping timeout: 268 seconds)21:47
*** xenador77 <xenador77!~xenador77@user/xenador77> has quit IRC (Ping timeout: 252 seconds)21:59
RPvmeson: I['m sure we discussed my jobserver patch in the past?22:26
*** erbo <erbo!~erik@linode.unixshell.se> has joined #yocto22:27
RPvmeson: https://git.yoctoproject.org/poky-contrib/commit/?h=rpurdie/wipqueue6&id=2f1f07c9d7f2f3b06d199172887bfc95e5aa4b79 was a version of it22:30
*** Xagen_ <Xagen_!~Xagen@99-135-179-142.lightspeed.austtx.sbcglobal.net> has joined #yocto22:33
*** Xagen <Xagen!~Xagen@99-135-179-142.lightspeed.austtx.sbcglobal.net> has quit IRC (Ping timeout: 245 seconds)22:34
*** agupta1_ <agupta1_!~agupta1@207.107.110.122> has quit IRC (Ping timeout: 240 seconds)22:39
*** erbo <erbo!~erik@linode.unixshell.se> has quit IRC (Ping timeout: 245 seconds)22:39
*** erbo <erbo!~erik@linode.unixshell.se> has joined #yocto22:44
*** amitk <amitk!~amit@103.59.74.120> has quit IRC (Ping timeout: 268 seconds)22:44
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 252 seconds)23:12
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Ping timeout: 268 seconds)23:23
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has joined #yocto23:33
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #yocto23:38
*** florian <florian!~florian@dynamic-002-243-129-026.2.243.pool.telefonica.de> has quit IRC (Ping timeout: 252 seconds)23:53

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!