Tuesday, 2022-11-22

*** Tokamak <Tokamak!~Tokamak@172.58.222.199> has joined #yocto00:13
*** Tokamak_ <Tokamak_!Tokamak@gateway/vpn/protonvpn/tokamak> has joined #yocto00:22
*** Tokamak <Tokamak!~Tokamak@172.58.222.199> has quit IRC (Ping timeout: 255 seconds)00:23
Saur[m]DvorkinDmitry: Regardless of parsing, you cannot use Bash arrays since the shell may be Dash, which does not support them.00:30
DvorkinDmitrySaur[m], oh! but I can declare -a myarr and set values... hmmm00:31
Saur[m]DvorkinDmitry: How do you need to access the values of ${IMG_ISP_P}? I.e., are you looping over the values, or do you need to be able to access them randomly?00:31
Saur[m]It works if your /bin/sh happens to be bash. But on another computer it may be dash and then it will fail.00:32
DvorkinDmitrySaur[m], do you have an idea how to separate simple string "xx,xxx,yyy" in IMAGE_CMD_my() correctly and take part #1, for example?00:38
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)00:38
*** kscherer <kscherer!~kscherer@bras-base-otwaon1146w-grc-21-184-147-79-201.dsl.bell.ca> has quit IRC (Quit: Konversation terminated!)00:46
*** payam <payam!~payam@c83-250-236-236.bredband.tele2.se> has quit IRC (Ping timeout: 248 seconds)01:12
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Quit: Leaving.)01:13
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 256 seconds)01:18
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto01:19
*** payam <payam!~payam@c83-250-236-236.bredband.tele2.se> has joined #yocto01:23
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 268 seconds)01:23
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto01:24
*** davidinux <davidinux!~davidinux@host-79-24-132-230.retail.telecomitalia.it> has quit IRC (Ping timeout: 268 seconds)02:03
*** davidinux <davidinux!~davidinux@95.251.15.59> has joined #yocto02:05
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #yocto02:27
*** starblue <starblue!~juergen@dslb-094-221-179-160.094.221.pools.vodafone-ip.de> has quit IRC (Ping timeout: 256 seconds)02:35
*** starblue <starblue!~juergen@dslb-094-221-177-142.094.221.pools.vodafone-ip.de> has joined #yocto02:37
*** Tokamak <Tokamak!~Tokamak@mobile-166-170-30-202.mycingular.net> has joined #yocto03:02
*** Tokamak_ <Tokamak_!Tokamak@gateway/vpn/protonvpn/tokamak> has quit IRC (Ping timeout: 248 seconds)03:03
*** camus <camus!~Instantbi@117.143.3.97> has joined #yocto03:46
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Quit: Leaving.)04:52
*** Crofton <Crofton!sid401373@id-401373.lymington.irccloud.com> has quit IRC (Read error: Software caused connection abort)05:05
*** Crofton <Crofton!sid401373@id-401373.lymington.irccloud.com> has joined #yocto05:05
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has quit IRC (Quit: The Lounge - https://thelounge.chat)05:06
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has joined #yocto05:07
*** camus1 <camus1!~Instantbi@2409:8a1e:9122:21b0:b45c:1283:cc54:1496> has joined #yocto05:17
*** camus <camus!~Instantbi@117.143.3.97> has quit IRC (Ping timeout: 268 seconds)05:19
*** camus1 is now known as camus05:19
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto05:51
*** gstinocher[m] <gstinocher[m]!~gstinoche@2001:470:69fc:105::2:358a> has quit IRC (Read error: Software caused connection abort)05:58
*** gstinocher[m] <gstinocher[m]!~gstinoche@2001:470:69fc:105::2:358a> has joined #yocto05:59
*** Guest1370 <Guest1370!~Guest13@46.221.0.162> has joined #yocto06:10
*** Guest1370 <Guest1370!~Guest13@46.221.0.162> has quit IRC (Quit: Client closed)06:17
*** kotylamichal <kotylamichal!~michal@84-10-27-202.static.chello.pl> has joined #yocto06:19
*** goliath <goliath!~goliath@user/goliath> has joined #yocto06:19
*** smurray <smurray!sid98062@id-98062.hampstead.irccloud.com> has quit IRC (Read error: Software caused connection abort)06:20
*** smurray <smurray!sid98062@id-98062.hampstead.irccloud.com> has joined #yocto06:20
*** Guest1338 <Guest1338!~Guest13@46.221.0.162> has joined #yocto06:23
*** rhadye <rhadye!sid217449@2a03:5180:f::3:5169> has quit IRC (Read error: Software caused connection abort)06:55
*** rhadye <rhadye!sid217449@id-217449.tinside.irccloud.com> has joined #yocto06:55
*** Lihis <Lihis!~Lihis@2001:41d0:e:f34::1> has quit IRC (Read error: Software caused connection abort)07:04
*** Lihis <Lihis!~Lihis@ns3006753.ip-151-80-42.eu> has joined #yocto07:04
Guest1338hi everyone. im trying to enable hdmi support on imx8mq(coral-dev-board). i couldnt find a solution for 3-4 days. i opened a topic(included kernel version,meta-layers):07:16
Guest1338https://community.nxp.com/t5/i-MX-Processors/imx8mq-coral-dev-board-hdmi-not-working/m-p/1556918#M19773807:16
Guest1338even any guidance would be helpful to me.07:16
*** mthenault <mthenault!~mthenault@ip-091-089-130-004.um28.pools.vodafone-ip.de> has joined #yocto07:25
*** tomzy_0 <tomzy_0!~tomzy_0@84-10-27-202.static.chello.pl> has joined #yocto07:27
*** xmn <xmn!~xmn@cpe-72-225-198-203.nyc.res.rr.com> has quit IRC (Ping timeout: 256 seconds)07:29
LetoThe2ndyo dudX07:39
LetoThe2ndGuest1338: I would suggest, try to find out which process is supposed to put something on the display, make sure it runs and look at its logs. the log you posted is just the boot process07:49
*** hcg <hcg!~hcg@213.55.241.64> has joined #yocto07:52
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto07:55
*** kotylamichal <kotylamichal!~michal@84-10-27-202.static.chello.pl> has quit IRC (Quit: Konversation terminated!)07:57
*** jclsn <jclsn!~jclsn@2a04:4540:6521:6000:2ce:39ff:fecf:efcd> has joined #yocto07:58
jclsnMorning boys and gals07:59
*** frieder <frieder!~frieder@200116b82446fb810000000000001cba.dip.versatel-1u1.de> has joined #yocto07:59
*** leon-anavi <leon-anavi!~Leon@46.55.231.62> has joined #yocto08:01
*** manuel1985 <manuel1985!~manuel198@185.144.162.58> has joined #yocto08:02
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Quit: SIGSEGV)08:05
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has joined #yocto08:06
*** Guest1338 <Guest1338!~Guest13@46.221.0.162> has quit IRC (Ping timeout: 260 seconds)08:08
*** dev1990 <dev1990!~dev@77-254-239-123.adsl.inetia.pl> has joined #yocto08:18
*** dev1990 <dev1990!~dev@77-254-239-123.adsl.inetia.pl> has quit IRC (Client Quit)08:18
*** Guest1327 <Guest1327!~Guest13@31.145.189.4> has joined #yocto08:25
*** Colin_Finck <Colin_Finck!~cfinck@outpost.colinfinck.de> has quit IRC (Read error: Software caused connection abort)08:27
*** Colin_Finck <Colin_Finck!~cfinck@outpost.colinfinck.de> has joined #yocto08:27
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Quit: alessioigor)08:35
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto08:35
*** mvlad <mvlad!~mvlad@2a02:2f08:4503:c400:24d7:51ff:fed6:906d> has joined #yocto08:37
*** Guest1327 <Guest1327!~Guest13@31.145.189.4> has quit IRC (Quit: Client closed)08:39
*** Herrie <Herrie!~Herrie@110-31-146-85.ftth.glasoperator.nl> has quit IRC (Read error: Connection reset by peer)08:46
*** Herrie <Herrie!~Herrie@110-31-146-85.ftth.glasoperator.nl> has joined #yocto08:51
*** bluelightning <bluelightning!uid552298@2a03:5180:f::8:6d6a> has quit IRC (Read error: Software caused connection abort)08:58
*** bluelightning <bluelightning!uid552298@id-552298.tinside.irccloud.com> has joined #yocto08:59
*** kanavin <kanavin!~Alexander@2a02:2454:29b:3b00:d35d:e3cf:58b5:748b> has quit IRC (Quit: Leaving)09:07
*** goliath <goliath!~goliath@user/goliath> has joined #yocto09:07
*** fmartinsons[m] <fmartinsons[m]!~fmartinso@2001:470:69fc:105::2:b3cc> has quit IRC (Read error: Software caused connection abort)09:22
*** fmartinsons[m] <fmartinsons[m]!~fmartinso@2001:470:69fc:105::2:b3cc> has joined #yocto09:22
*** Guest36 <Guest36!~Guest36@193.28.217.23> has joined #yocto09:23
Guest36Hello @ALL09:24
*** kanavin <kanavin!~Alexander@2a02:2454:29b:3b00:d35d:e3cf:58b5:748b> has joined #yocto09:25
Guest36how to build a bootable Image for x86_64 ?09:25
Guest36what I need to set in poky/build/conf/local.conf ?09:25
LetoThe2ndGuest36: have you tried and completed (and hopefully understood) a first quick start build for qemux86_64?09:26
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has quit IRC (Quit: The Lounge - https://thelounge.chat)09:26
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has joined #yocto09:27
Guest36got a file: core-image-sato-qemux86-64-20221122052528.rootfs.ext409:28
LetoThe2ndGuest36: yeah, as this is a build for the specified qemu machine, it obviously produces something that qemu can use to run. good. the next step is then to add the meta-intel layer, adjust the MACHINE and build again. please see the documentation for this: https://git.yoctoproject.org/meta-intel/tree/README09:30
Guest36LetoThe2nd: thanks will try09:31
*** florian <florian!~florian@port-217-146-132-69.static.as20676.net> has joined #yocto09:35
jclsnWhat book do you recommend for getting to know the kernel? I am still struggling to debug it when something is going wrong09:54
*** glgspg[m] <glgspg[m]!~glgspgmat@2001:470:69fc:105::2:c448> has joined #yocto10:03
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 260 seconds)10:12
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 268 seconds)10:18
*** dlan <dlan!~dennis@gentoo/developer/dlan> has quit IRC (Ping timeout: 246 seconds)10:21
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Quit: alessioigor)10:25
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto10:25
*** grma <grma!~gruberm@80.93.38.128> has quit IRC (Ping timeout: 268 seconds)10:25
*** rber|res <rber|res!~rber|res@62-46-95-169.adsl.highway.telekom.at> has joined #yocto10:26
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto10:26
*** dlan <dlan!~dennis@gentoo/developer/dlan> has joined #yocto10:28
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 240 seconds)10:31
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has joined #yocto10:31
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto10:32
*** Salamandar <Salamandar!~salamanda@2001:470:69fc:105::ecd> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** fabatera[m] <fabatera[m]!~fabateram@2001:470:69fc:105::18d5> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** T_UNIX[m] <T_UNIX[m]!~tunixmatr@2001:470:69fc:105::9ea> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** michaelo[m] <michaelo[m]!~michael-o@2001:470:69fc:105::be7c> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** Saur[m] <Saur[m]!~saur2000m@2001:470:69fc:105::dce> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** khem <khem!~khem@2001:470:69fc:105::b81> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** janvermaete[m] <janvermaete[m]!~vermaetem@2001:470:69fc:105::ee7> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** lrusak[m] <lrusak[m]!~lrusakmat@2001:470:69fc:105::732> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** agherzan <agherzan!~agherzan@2001:470:69fc:105::e1fe> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** esben[m] <esben[m]!~esbengean@2001:470:69fc:105::1:3510> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** barath <barath!~barath@2001:470:69fc:105::21a> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** mrybczyn[m] <mrybczyn[m]!~mrybczynm@2001:470:69fc:105::1467> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** ble[m] <ble[m]!~jmartenka@2001:470:69fc:105::2:ad97> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** matiop6[m] <matiop6[m]!~matiop6ma@2001:470:69fc:105::2:b843> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** ramacassis[m] <ramacassis[m]!~ramacassi@2001:470:69fc:105::2:1958> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** cperon <cperon!~cperonmat@2001:470:69fc:105::2d1a> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** aleblanc[m] <aleblanc[m]!~aleblancm@2001:470:69fc:105::1:c14f> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** kiwi_29_[m] <kiwi_29_[m]!~msgboardp@2001:470:69fc:105::1:6699> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** hmw[m] <hmw[m]!~hmwmatrix@2001:470:69fc:105::3c7c> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** protu[m] <protu[m]!~protumatr@2001:470:69fc:105::1:3641> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** Theo[m] <Theo[m]!~tcdiemmat@2001:470:69fc:105::2:3531> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** jkorsnes[m] <jkorsnes[m]!~johankorm@2001:470:69fc:105::2:7acb> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** ThomasRoos[m] <ThomasRoos[m]!~thomasroo@2001:470:69fc:105::2:2017> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** danielt <danielt!~danielt@2001:470:69fc:105::34d8> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** Peter[m]12345 <Peter[m]12345!~chiefdome@2001:470:69fc:105::2:bfd6> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** styloge[m] <styloge[m]!~stylogema@2001:470:69fc:105::2:bfe3> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** berton[m] <berton[m]!~berton@2001:470:69fc:105::ce36> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** hiyorijl[m] <hiyorijl[m]!~hiyorijlm@2001:470:69fc:105::2:ae98> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** ejoerns[m] <ejoerns[m]!~ejoernsma@2001:470:69fc:105::252> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** ericson2314 <ericson2314!~ericson23@2001:470:69fc:105::70c> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** fmartinsons[m] <fmartinsons[m]!~fmartinso@2001:470:69fc:105::2:b3cc> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** zyga[m] <zyga[m]!~zygafosde@2001:470:69fc:105::11f7> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** Tartarus <Tartarus!~tr1265@2001:470:69fc:105::1:4b21> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** EwelusiaGsiorek[ <EwelusiaGsiorek[!~ewelinaga@2001:470:69fc:105::2:b0e7> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** PascalBach[m] <PascalBach[m]!~bachpmatr@2001:470:69fc:105::1d3b> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** shoragan[m] <shoragan[m]!~shoraganm@2001:470:69fc:105::39> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** gstinocher[m] <gstinocher[m]!~gstinoche@2001:470:69fc:105::2:358a> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** glgspg[m] <glgspg[m]!~glgspgmat@2001:470:69fc:105::2:c448> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** mborzecki <mborzecki!~mborzecki@2001:470:69fc:105::2af6> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** patersonc[m] <patersonc[m]!~patersonc@2001:470:69fc:105::aaf> has quit IRC (Quit: Bridge terminating on SIGTERM)10:35
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 240 seconds)10:36
*** khem <khem!~khem@2001:470:69fc:105::b81> has joined #yocto10:38
*** zyga[m] <zyga[m]!~zygafosde@2001:470:69fc:105::11f7> has joined #yocto10:41
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto10:44
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto10:48
qschulzAre we supposed to be able to share DL_DIR between concurrent builds?10:50
*** Salamandar <Salamandar!~salamanda@2001:470:69fc:105::ecd> has joined #yocto10:50
*** shoragan[m] <shoragan[m]!~shoraganm@2001:470:69fc:105::39> has joined #yocto10:50
*** patersonc[m] <patersonc[m]!~patersonc@2001:470:69fc:105::aaf> has joined #yocto10:50
*** barath <barath!~barath@2001:470:69fc:105::21a> has joined #yocto10:50
qschulzI'm seeing some weird file corruption10:51
*** michaelo[m] <michaelo[m]!~michael-o@2001:470:69fc:105::be7c> has joined #yocto10:51
*** ble[m] <ble[m]!~jmartenka@2001:470:69fc:105::2:ad97> has joined #yocto10:51
*** johankor[m] <johankor[m]!~johankorm@2001:470:69fc:105::2:7acb> has joined #yocto10:51
*** hiyorijl[m] <hiyorijl[m]!~hiyorijlm@2001:470:69fc:105::2:ae98> has joined #yocto10:51
*** danielt <danielt!~danielt@2001:470:69fc:105::34d8> has joined #yocto10:51
*** protu[m] <protu[m]!~protumatr@2001:470:69fc:105::1:3641> has joined #yocto10:51
*** ericson2314 <ericson2314!~ericson23@2001:470:69fc:105::70c> has joined #yocto10:51
*** Tartarus <Tartarus!~tr1265@2001:470:69fc:105::1:4b21> has joined #yocto10:51
*** lrusak[m] <lrusak[m]!~lrusakmat@2001:470:69fc:105::732> has joined #yocto10:51
*** EwelusiaGsiorek[ <EwelusiaGsiorek[!~ewelinaga@2001:470:69fc:105::2:b0e7> has joined #yocto10:51
*** agherzan <agherzan!~agherzan@2001:470:69fc:105::e1fe> has joined #yocto10:51
*** Saur[m] <Saur[m]!~saur2000m@2001:470:69fc:105::dce> has joined #yocto10:51
*** mrybczyn[m] <mrybczyn[m]!~mrybczynm@2001:470:69fc:105::1467> has joined #yocto10:51
*** T_UNIX[m] <T_UNIX[m]!~tunixmatr@2001:470:69fc:105::9ea> has joined #yocto10:51
*** gstinocher[m] <gstinocher[m]!~gstinoche@2001:470:69fc:105::2:358a> has joined #yocto10:51
qschulzone server has an ext4 filesystem exported as nfs to server 210:51
*** fmartinsons[m] <fmartinsons[m]!~fmartinso@2001:470:69fc:105::2:b3cc> has joined #yocto10:52
*** Theo[m] <Theo[m]!~tcdiemmat@2001:470:69fc:105::2:3531> has joined #yocto10:52
qschulz(kirkstone 4.0.5)10:52
*** kiwi_29_[m] <kiwi_29_[m]!~msgboardp@2001:470:69fc:105::1:6699> has joined #yocto10:52
*** matiop6[m] <matiop6[m]!~matiop6ma@2001:470:69fc:105::2:b843> has joined #yocto10:52
*** PascalBach[m] <PascalBach[m]!~bachpmatr@2001:470:69fc:105::1d3b> has joined #yocto10:52
*** mborzecki <mborzecki!~mborzecki@2001:470:69fc:105::2af6> has joined #yocto10:52
*** ramacassis[m] <ramacassis[m]!~ramacassi@2001:470:69fc:105::2:1958> has joined #yocto10:53
qschulzthe file is https://downloads.yoctoproject.org/mirror/sources/gitshallow_sourceware.org.git.binutils-gdb.git_dc2474e-1_binutils-2_38-branch.tar.gz (mirror for binutils)10:53
*** cperon <cperon!~cperonmat@2001:470:69fc:105::2d1a> has joined #yocto10:53
*** aleblanc[m] <aleblanc[m]!~aleblancm@2001:470:69fc:105::1:c14f> has joined #yocto10:53
*** hmw[m] <hmw[m]!~hmwmatrix@2001:470:69fc:105::3c7c> has joined #yocto10:53
rburtonthe AB does that, nfs share for DL_DIR10:53
*** fabatera[m] <fabatera[m]!~fabateram@2001:470:69fc:105::18d5> has joined #yocto10:53
rburtonhas to be a working nfs server with locking that works10:53
qschulzwhere is the DL_DIR original filesystem located on?10:54
*** glgspg[m] <glgspg[m]!~glgspgmat@2001:470:69fc:105::2:c448> has joined #yocto10:54
*** esben[m] <esben[m]!~esbengean@2001:470:69fc:105::1:3510> has joined #yocto10:54
qschulzand is the server where it is located on running Yocto builds?10:54
*** ThomasRoos[m] <ThomasRoos[m]!~thomasroo@2001:470:69fc:105::2:2017> has joined #yocto10:54
qschulzrburton: would you happen to have the mount options?10:54
*** janvermaete[m] <janvermaete[m]!~vermaetem@2001:470:69fc:105::ee7> has joined #yocto10:54
*** ejoerns[m] <ejoerns[m]!~ejoernsma@2001:470:69fc:105::252> has joined #yocto10:54
qschulzwe are running nfs 4.2 so no explicit locking in mount options AFAICT10:54
rburtonin the AB? there's a NFS appliance that just hosts sstate and dl_dir, and the clients all mount it10:54
*** Peter[m]1 <Peter[m]1!~chiefdome@2001:470:69fc:105::2:bfd6> has joined #yocto10:54
*** styloge[m] <styloge[m]!~stylogema@2001:470:69fc:105::2:bfe3> has joined #yocto10:55
qschulzyeah, that's a different scenario from us (though we could probably replicate this with a local NFS mount)10:55
*** berton[m] <berton[m]!~berton@2001:470:69fc:105::ce36> has joined #yocto10:55
rburtonif locking works then writes should be atomic10:55
qschulzWe did a local wget oif this same file on both servers at the same time and the data was valid at the end of both downloads10:55
*** starblue <starblue!~juergen@dslb-094-221-177-142.094.221.pools.vodafone-ip.de> has quit IRC (Ping timeout: 248 seconds)10:55
rburtonunless the shallow tarball stuff is racy and nobody noticed10:55
qschulzrburton: yeah but that's locks on two different filesystems10:56
qschulzso I wouldn't trust it too much (though the wget test we did was surprisingly working ok)10:56
*** johankor[m] is now known as jkorsnes[m]10:56
qschulz(I mean "surprisingly" because that was the culprit I had thought of initially)10:57
*** starblue <starblue!~juergen@dslb-094-221-177-142.094.221.pools.vodafone-ip.de> has joined #yocto10:57
*** grma <grma!~gruberm@80.93.38.128> has joined #yocto10:59
*** jclsn <jclsn!~jclsn@2a04:4540:6521:6000:2ce:39ff:fecf:efcd> has quit IRC (Ping timeout: 260 seconds)11:01
*** rber|res <rber|res!~rber|res@62-46-95-169.adsl.highway.telekom.at> has quit IRC (Remote host closed the connection)11:02
*** florian_kc <florian_kc!~florian@port-217-146-132-69.static.as20676.net> has joined #yocto11:02
RPqschulz: the nfs server is a dedicated BSD based nas appliance11:13
RPqschulz: I'd be tempted to print out the lockfile the fetcher is using (ud.lockfile) and see if there are conflicts. It is possible mutliple urls are mapping back to the same mirror tarball name11:19
RPthere have been a lot of changes (submodules, shallow clones) to the fetcher and nobody pays much attention to whether it works with the core lockfile11:20
RPit looks like it locks based on ud.clonedir for git11:20
* RP notices several potential bugs looking at the git fetcher code and feels sad/depressed11:24
*** hcg <hcg!~hcg@213.55.241.64> has quit IRC (Ping timeout: 260 seconds)11:29
*** Guest36 <Guest36!~Guest36@193.28.217.23> has quit IRC (Ping timeout: 260 seconds)11:31
qschulzRP: the wget fetcher is racy11:35
qschulzrburton: ^11:35
RPqschulz: can you be more specific?11:35
qschulzRP: yes, just in a call at the same time11:36
qschulzhttps://git.openembedded.org/bitbake/tree/lib/bb/fetch2/wget.py#n12711:36
RPqschulz: two questions - a) you are using the top level api, not the wget fetcher directly? and b) which version are you looking at, I added atomic move code in a recent version11:37
qschulzso, I have one server starting a download of the file, which then DOES exist11:37
qschulzthe second server is starting to download the file too and sees it exists11:37
RPqschulz: there is locking in the higher level function11:37
qschulzso uses wget -c11:37
qschulzwhich opens the file in append mode11:38
qschulzRP: we're using kirkstone 4.0.511:38
RPqschulz: well, my point about high level locking stands11:38
qschulzRP: high level locking on the fs?11:38
RPqschulz: in the bitbake code. The wrapper around download() in __init__.py is meant to hold a lock so only one download for a given file can be called at once11:39
RPqschulz: https://git.openembedded.org/bitbake/tree/lib/bb/fetch2/__init__.py#n173011:40
*** jclsn <jclsn!~jclsn@2a04:4540:6507:d900:2ce:39ff:fecf:efcd> has joined #yocto11:40
qschulzRP: looking at it, also keep in mind this is using a premirror, so might have a slightly more convoluted code path11:41
RPqschulz: hence my comments above about looking at what it is using for ud.localfile11:41
RPer, ud.lockfile11:41
RPqschulz: https://git.openembedded.org/bitbake/commit/lib/bb/fetch2/wget.py?id=cd7cce4cf4be5c742d29671169354fe84220b47a FWIW11:41
RPqschulz: I really should have explained that in the commit message :(11:42
RPbasically if you expose DL_DIR over http without locking you need that11:42
qschulzNot over HTTP, over NFS for us11:42
qschulzIf I were to provide a mirror, I would do the BB_GENERATE_MIRROR_TARBALLS stuff and rsync it to a dir exposed by a webserver11:43
qschulzbut thanks, will hopefully have this in mind, were my future me have different plans :)11:43
RPqschulz: right, some mirrors (e.g. the YP one) do share DL_DIR directly over http which was causing occasional race issues11:44
* qschulz looks into how to add patches to poky with kas...11:47
*** Tokamak_ <Tokamak_!~Tokamak@172.58.230.149> has joined #yocto11:58
*** Tokamak <Tokamak!~Tokamak@mobile-166-170-30-202.mycingular.net> has quit IRC (Ping timeout: 255 seconds)12:01
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)12:05
*** tomzy_0 <tomzy_0!~tomzy_0@84-10-27-202.static.chello.pl> has quit IRC (Quit: Client closed)12:05
*** GuestNew <GuestNew!~GuestNew@81.255.17.35> has joined #yocto12:12
GuestNewHi, OOM killer is called during custom package build (arm-cowt-linux-gnueabi-g++: fatal error: Killed signal terminated program cc1plus). If I call the build again twice, no issue.  Is it possible to reduce the number of threads for only one recipe ?12:14
rburtonsure, drop PARALLEL_MAKE12:15
rburtonor just reduce BB_NUMBER_THREADS globally12:15
LetoThe2ndrburton: lame. buy more RAM.12:15
rburtonboth default to number-of-cores, which might be too much if you don't have enough RAM12:16
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto12:16
rburtonbuying more RAM is the true answer12:16
rburtonLetoThe2nd: in writing my slides i discovered that 1tb of nvme ssd is <£100, so I've officially dropped my "buy lots of ram, use tmpfs" tip for fast builds. :)12:16
LetoThe2ndrburton: lame, writing slides less than 24h before presenting.12:22
rburtonndec will go HULK SMASH if they're not uploaded by friday12:25
LetoThe2ndrburton: now i want to see that.12:25
GuestNewrburton I don't want (if it's possible to configure it globally)12:31
GuestNewLetoThe2nd already 64Go ... should be enough12:31
qschulzGuestNew: how many cores and are you building a browser or complex C++ applications?12:31
*** denisoft81 <denisoft81!~denisoft8@host-79-21-199-193.retail.telecomitalia.it> has joined #yocto12:32
GuestNewqschulz max of my i9-10980XE so 6412:32
rburtonGuestNew: globally, set BB_NUMBER_THREADS to 32 and PARALLEL_MAKE to -j32.12:33
rburtonyou'll oom less and i expect the build will be no slower12:33
rburtonhell, 16 will be fine12:33
GuestNewrburton ok thanks i will make a try12:34
LetoThe2ndGuestNew: for building complex c++ applications, 2-4GB of RAM per thread should be allocated. and I confirm, we ran extensive tests of parallelism from 1 up to 256, and everything above roughly 20 (give or take some) is very much neglegible these days.12:34
qschulzGuestNew: on consumer grade PC, we usually recommend twice the number of CPU cores in RAM, but once you enter server grade, you need much more RAM12:35
qschulzand since I don't have much experience with server grade and we are not building complex things here, I'll let the pro handle this question/follow-up :)12:36
qschulzRP: https://paste.ack.tf/94ca6512:36
RPrburton: I should buy some fast disks for my builder12:36
rburtonRP: 1tb nvme wd black, £103 quid on scan12:36
GuestNewEXTRA_OEMAKE can used if I want to compare ? rburton LetoThe2nd qschulz thanks for support guys!12:36
rburtonGuestNew: no, set the PARALLEL_MAKE and BB_NUMBER_THREADS12:36
LetoThe2ndGuestNew: there is a testing script somewhere in the wiki, rburton actually wrote it AFAIK12:36
qschulzRP: https://paste.ack.tf/3a7ae2 for the diff12:37
rburtonLetoThe2nd: nope, jama iirc12:37
rburtonor was it dvhart12:37
rburtonmight have been darren12:37
LetoThe2ndrburton: old white metalheads, flaky memory.12:37
* LetoThe2nd builds on a relatively cheapo i7 hosted by hetzner these days.12:37
qschulzRP: reminder that one system has this path as an ext4 (native obviously) and one as NFS mounted from the first system. Also, we mount those inside our containers for building12:38
qschulzRP: lsof complains on the NFS share for the /mnt/nfs-shared-cache/yocto/downloads/git2/sourceware.org.git.binutils-gdb.git.lock12:39
qschulzlsof: WARNING: can't stat() ext4 file system /var/lib/containers/storage/overlay12:40
qschulz      Output information may be incomplete.12:40
RPqschulz: I can't tell just from the log whether the locks are the right ones to hold but it seems reasonable? Have you tried holding a lock from within the container and then on the nfs server ?12:41
RPqschulz: i.e. actually just test the locking works12:41
RPqschulz: the stat() failure sounds ominous12:42
rburtonyeah i wonder if the overlayfs stuff is breaking locks12:42
RPqschulz: I was worried the shallow clone would cause a problem but it is holding two locks, one shallow, one not so it looks like that case is covered12:43
RPqschulz: my favourite trick for debugging this is a time.sleep(100000) somewhere in the code when the lock is held, then you can poke elsewhere12:46
RPrburton: that gl patch ;-)12:46
rburtonerm yeah12:47
qschulzRP: I'm going the flock way in a shell within the container with mounted volumes for now :)12:50
qschulzaaaaaaand the locks don't work12:51
qschulz"flock -u plop -c 'for i in `seq 0 10`; do echo $i; sleep 1; done'" on server1 within container and also on server2 within container12:52
qschulzboth run concurrently12:52
qschulzoh the stuff of nightmares12:52
RPqschulz: that would be why things aren't working then :/12:54
qschulzin two different containers on the same host, same behavior12:54
qschulzRP: sorry for the scares then, "happy" it's an issue on "my" side :)12:54
RPqschulz: np, I could believe we had problems in there!12:54
qschulzRP: also tried to reproduce the parsing cache invalidation miss I had with U-Boot on plain poky but didn't manage to yet.. will let you know if/how I can12:55
RPqschulz: ok, thanks12:56
qschulzRP: nvm, I swapped -u and -n12:56
qschulz(unlock and non-block)12:56
qschulzso on the same server the locks work, but not across servers12:57
qschulzshould have been: flock -n plop -c 'for i in `seq 0 10`; do echo $i; sleep 1; done'12:57
qschulzsoooo, server1 with ext4, server2 and server3 with NFS. Containers on same server: locks ok. Containers on server2 and server3: locks ok. Containers on server1 and server2: locks NOK.13:00
qschulzsame outside of containers13:01
qschulzRP: ok, so the issue is that NFS translates flocks into fcntl syscall and bitbake uses flocks13:10
qschulzsee https://manned.org/nfs.5#head9 section "Using file locks with NFS"13:10
qschulzand locks from flocks aren't aware of fcntl locks (and/or vice-versa)13:10
qschulzusing this program https://www.informit.com/articles/article.aspx?p=23618&seqNum=4 which uses the fcntl ioctl, the lock works across servers with ext4/nfs13:11
*** denisoft81 <denisoft81!~denisoft8@host-79-21-199-193.retail.telecomitalia.it> has quit IRC (Quit: Leaving)13:16
RPqschulz: I guess it is siutation dependent as flock is working on on the autobuilder13:18
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Quit: alessioigor)13:30
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto13:30
*** GuestNew <GuestNew!~GuestNew@81.255.17.35> has quit IRC (Quit: Client closed)13:32
*** d-s-e <d-s-e!~d.s.e@2001:a61:125e:6401:951:605:9993:998> has joined #yocto13:46
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #yocto13:47
*** d-s-e <d-s-e!~d.s.e@2001:a61:125e:6401:951:605:9993:998> has quit IRC (Ping timeout: 246 seconds)13:52
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has quit IRC (Quit: The Lounge - https://thelounge.chat)13:56
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has joined #yocto13:57
qschulzRP: it works when everything is using NFS, which is the case of the autobuilder13:58
qschulzRP: but if you were to have one of the autobuilder use another fs instead of NFS, then you would have the issue13:59
qschulzwondering if/how this should be documented13:59
RPqschulz: good questions :/14:02
*** Tokamak <Tokamak!~Tokamak@166.205.152.52> has joined #yocto14:03
*** Tokamak_ <Tokamak_!~Tokamak@172.58.230.149> has quit IRC (Ping timeout: 252 seconds)14:05
*** mthenault <mthenault!~mthenault@ip-091-089-130-004.um28.pools.vodafone-ip.de> has quit IRC (Quit: Leaving)14:06
*** d-s-e <d-s-e!~d.s.e@2001:a61:125e:6401:951:605:9993:998> has joined #yocto14:08
*** GuestNew <GuestNew!~GuestNew@81.255.17.35> has joined #yocto14:09
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 268 seconds)14:09
*** GuestNew <GuestNew!~GuestNew@81.255.17.35> has left #yocto14:09
*** Nini <Nini!~Nini@81.255.17.35> has joined #yocto14:11
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has joined #yocto14:11
NiniHello, there is a way to execute bash/shell arithmetic operation on environnent variable to set bitbake variable value ? aka BITBAKE_VAR = $(SHELL_VAR1 + SHELL_VAR2 )14:15
*** d-s-e <d-s-e!~d.s.e@2001:a61:125e:6401:951:605:9993:998> has quit IRC (Quit: Konversation terminated!)14:15
rburtonyou mean $(( )), but sadly the parser doesn't handle that https://bugzilla.yoctoproject.org/show_bug.cgi?id=1131414:16
rburtonyou can use expr though14:16
rburtonshouldn't be *that* difficult to fix the parser, its just that nobody has done it14:17
Ninirburton ok thanks for info, agree looks "simple" but "simple" is never simple14:18
*** xmn <xmn!~xmn@cpe-72-225-198-203.nyc.res.rr.com> has joined #yocto14:22
rburtonactually this might be really simple14:24
*** camus <camus!~Instantbi@2409:8a1e:9122:21b0:b45c:1283:cc54:1496> has quit IRC (Remote host closed the connection)14:30
*** camus <camus!~Instantbi@2409:8a1e:9122:21b0:b45c:1283:cc54:1496> has joined #yocto14:31
rburtonwell okay moderately14:34
* rburton wonders how pyshlex works14:34
*** pgowda_ <pgowda_!uid516182@id-516182.ilkley.irccloud.com> has joined #yocto14:45
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 252 seconds)14:50
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)14:58
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto14:59
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Quit: alessioigor)15:01
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto15:01
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 252 seconds)15:03
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto15:04
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto15:05
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 252 seconds)15:14
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto15:14
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)15:15
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto15:15
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 260 seconds)15:16
*** rcw <rcw!~rcwoolley@216.154.26.130> has joined #yocto15:28
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Quit: SIGSEGV)15:30
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has joined #yocto15:30
*** amitk <amitk!~amit@103.208.71.104> has joined #yocto15:32
*** Nini <Nini!~Nini@81.255.17.35> has quit IRC (Quit: Client closed)15:32
*** Herrie <Herrie!~Herrie@110-31-146-85.ftth.glasoperator.nl> has quit IRC (Ping timeout: 260 seconds)15:35
*** kscherer <kscherer!~kscherer@bras-base-otwaon1146w-grc-21-184-147-79-201.dsl.bell.ca> has joined #yocto15:36
*** Tokamak <Tokamak!~Tokamak@166.205.152.52> has quit IRC (Read error: Connection reset by peer)15:39
*** Tokamak <Tokamak!~Tokamak@166.205.152.52> has joined #yocto15:40
*** Mickal[m] <Mickal[m]!~kml84matr@2001:470:69fc:105::2:c488> has joined #yocto15:42
*** hcg <hcg!~hcg@213.55.241.64> has joined #yocto15:43
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 260 seconds)15:44
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto15:47
*** camus1 <camus1!~Instantbi@117.143.3.97> has joined #yocto15:54
*** camus <camus!~Instantbi@2409:8a1e:9122:21b0:b45c:1283:cc54:1496> has quit IRC (Ping timeout: 252 seconds)15:55
*** camus1 is now known as camus15:55
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has quit IRC (Quit: Leaving.)16:00
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has joined #yocto16:00
frayI'm trying to construct a disk (sd card) image using wic that has a boot and root split.  boot disk being vfat.  The problem I'm having is I can't figure out how to actually SPLIT the root to /boot.  It appears I need to specify everything in IMAGE_BOOT_FILES and they get copied from the tmp/deploy, that isn't what I want.  There are already packages installing the files into /boot.    So if I boot the board,16:03
frayUNMOUNT /boot the files I actually want are there.16:03
frayAnyone have any suggestions how to do this?16:03
qschulzfray: meta-rockchip does this already16:05
qschulzhttps://git.yoctoproject.org/meta-rockchip/tree/wic/rockchip.wks16:05
qschulzbootimg-partition might be the trick?16:06
fraythat is what I'm using...16:07
frayI don't have this: --sourceparams="loader=u-boot"16:08
fraybut I'm not sure what that is16:08
*** marek7 <marek7!~marek@90-64-78-64.dynamic.orange.sk> has joined #yocto16:08
marek7hi, when compile php in yocto it's missing some dns functions like compared same evrsion compiled on x86 manually:16:09
marek7```php -r 'var_dump(get_defined_functions());' | grep dns16:09
marek7    string(16) "dns_check_record"16:09
marek7    string(10) "checkdnsrr"16:09
marek7    string(10) "dns_get_mx"16:09
marek7    string(14) "dns_get_record"16:09
marek7```16:09
marek7on my embedded device it return empty16:09
marek7any ideas if I'm missing some dependency maybe?16:09
*** manuel1985 <manuel1985!~manuel198@185.144.162.58> has quit IRC (Ping timeout: 268 seconds)16:09
frayqschulz: from a quick look, it looks like rockchip isn't pulling from the root (/) for /boot, but using IMAGE_BOOT_FILES from deploy as well..16:11
*** hcg <hcg!~hcg@213.55.241.64> has quit IRC (Quit: Client closed)16:15
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 268 seconds)16:17
*** prabhakarlad58 <prabhakarlad58!~prabhakar@pc.renesas.eu> has joined #yocto16:17
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Ping timeout: 260 seconds)16:21
*** hcg <hcg!~hcg@213.55.241.64> has joined #yocto16:26
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Quit: alessioigor)16:26
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto16:32
*** gsalazar <gsalazar!~gsalazar@139.0.166.178.rev.vodafone.pt> has quit IRC (Ping timeout: 260 seconds)16:40
*** amitk_ <amitk_!~amit@103.208.71.104> has joined #yocto16:44
*** florian_kc <florian_kc!~florian@port-217-146-132-69.static.as20676.net> has quit IRC (Ping timeout: 246 seconds)16:44
*** seninha <seninha!~seninha@user/seninha> has joined #yocto16:46
*** amitk_ <amitk_!~amit@103.208.71.104> has quit IRC (Ping timeout: 256 seconds)16:49
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 260 seconds)16:50
*** gho <gho!~gho@i59F5CD49.versanet.de> has joined #yocto16:52
*** amitk_ <amitk_!~amit@103.208.71.104> has joined #yocto16:54
*** gho <gho!~gho@i59F5CD49.versanet.de> has quit IRC (Ping timeout: 268 seconds)16:57
*** kris <kris!~chaplin@38.9.11.14> has quit IRC (Quit: WeeChat 1.9.1)17:10
*** hcg <hcg!~hcg@213.55.241.64> has quit IRC (Quit: Client closed)17:10
*** camus <camus!~Instantbi@117.143.3.97> has quit IRC (Ping timeout: 248 seconds)17:13
*** gsalazar <gsalazar!~gsalazar@isep.wan.ipp.pt> has joined #yocto17:22
*** pgowda_ <pgowda_!uid516182@id-516182.ilkley.irccloud.com> has quit IRC (Quit: Connection closed for inactivity)17:25
*** florian_kc <florian_kc!~florian@port-217-146-132-69.static.as20676.net> has joined #yocto17:26
*** mischief <mischief!~mischief@wopr.sciops.net> has joined #yocto17:26
*** florian_kc <florian_kc!~florian@port-217-146-132-69.static.as20676.net> has quit IRC (Ping timeout: 260 seconds)17:31
*** amitk_ <amitk_!~amit@103.208.71.104> has quit IRC (Ping timeout: 252 seconds)17:31
*** amitk_ <amitk_!~amit@103.208.71.104> has joined #yocto17:36
*** Herrie <Herrie!~Herrie@110-31-146-85.ftth.glasoperator.nl> has joined #yocto17:38
*** frieder <frieder!~frieder@200116b82446fb810000000000001cba.dip.versatel-1u1.de> has quit IRC (Remote host closed the connection)17:42
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has joined #yocto17:47
*** alessioigor <alessioigor!~alessioig@185.178.95.254> has quit IRC (Remote host closed the connection)17:47
*** mrpelotazo <mrpelotazo!~mrpelotaz@user/mrpelotazo> has quit IRC (Read error: Connection reset by peer)17:54
*** mrpelotazo <mrpelotazo!~mrpelotaz@user/mrpelotazo> has joined #yocto17:58
*** leon-anavi <leon-anavi!~Leon@46.55.231.62> has quit IRC (Quit: Leaving)18:03
*** zpfvo <zpfvo!~fvo@i59F5CD49.versanet.de> has quit IRC (Quit: Leaving.)18:04
*** florian_kc <florian_kc!~florian@dynamic-093-131-150-254.93.131.pool.telefonica.de> has joined #yocto18:09
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 252 seconds)18:09
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto18:09
*** seninha <seninha!~seninha@user/seninha> has quit IRC (Remote host closed the connection)18:10
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 260 seconds)18:14
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto18:14
*** florian_kc <florian_kc!~florian@dynamic-093-131-150-254.93.131.pool.telefonica.de> has quit IRC (Ping timeout: 260 seconds)18:19
*** prabhakarlad58 <prabhakarlad58!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)18:21
*** amitk_ <amitk_!~amit@103.208.71.104> has quit IRC (Remote host closed the connection)18:26
*** amitk <amitk!~amit@103.208.71.104> has quit IRC (Ping timeout: 246 seconds)18:33
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto18:41
*** ZI7 <ZI7!~ZI@2a0c:b381:462:9800:499c:fe17:ee88:f83e> has joined #yocto18:58
*** gsalazar <gsalazar!~gsalazar@isep.wan.ipp.pt> has quit IRC (Ping timeout: 252 seconds)19:05
*** tor <tor!~tor@user/tor> has quit IRC (Quit: Leaving)19:10
*** Haxxa <Haxxa!~Haxxa@202-65-79-43.ip4.superloop.com> has quit IRC (Quit: Haxxa flies away.)19:15
*** Haxxa <Haxxa!~Haxxa@89nnjg0xckz9ggn6r5xm.ip6.superloop.com> has joined #yocto19:17
*** ZI7 <ZI7!~ZI@2a0c:b381:462:9800:499c:fe17:ee88:f83e> has quit IRC (Ping timeout: 260 seconds)20:04
*** mvlad <mvlad!~mvlad@2a02:2f08:4503:c400:24d7:51ff:fed6:906d> has quit IRC (Remote host closed the connection)20:18
*** marek7 <marek7!~marek@90-64-78-64.dynamic.orange.sk> has quit IRC (Quit: Client closed)20:19
*** florian_kc <florian_kc!~florian@dynamic-093-131-150-254.93.131.pool.telefonica.de> has joined #yocto20:57
*** gsalazar <gsalazar!~gsalazar@139.0.166.178.rev.vodafone.pt> has joined #yocto20:58
*** FredericOuellet[ <FredericOuellet[!~tazura562@2001:470:69fc:105::1:3c31> has joined #yocto21:02
JPEWRP: I was looking at your branch for storing the cache data, and from my profiling it looks like the current bottle neck (with a few micro-optimizations I did) is now the de-pickle of data over the queue from the parser threads to the main thread. It's about 20% of the CPU time now, when it was much smaller21:27
*** goliath <goliath!~goliath@user/goliath> has joined #yocto21:40
RPJPEW: interesting, that wasn't what I was seeing :/. Was that with the -P option or something else?21:47
JPEWRP: Ya, with -P. My parse takes about 17 seconds and _pickel.loads is 4s, select.poll is 3 and posix.read is 321:49
JPEWI think it's because we are sending more data from the parser threads?21:49
RPJPEW: that would make sense, it just isn't where my profile shows the change :/21:49
RPJPEW: if that is where it is showing, we may be better off sending the data after all the recipes are parsed, condense it with de-dup before sending21:50
JPEWYa, I was trying to figure out how to do that21:50
JPEWI have the deduping down to 2.2 seconds21:50
RPJPEW: I have a patch for the other way, one second21:50
JPEWRP: For reference, on master _pickle.loads only takes 0.708 of 11 total seconds21:54
RPJPEW: https://git.yoctoproject.org/poky-contrib/commit/?h=rpurdie/t222&id=637514ad85165ddab1dd78766c13db7f35a9a6fa but it doesn't do what we want. It does show the stream you'd want to tag on the end of though21:55
* RP is getting confused between the different patches21:55
JPEWThe parsing threads are sending datastores across the queue right?21:56
JPEWIt's not a simple dictionary per-se21:56
RPJPEW: no, they send cache objects21:57
RPJPEW: CoreRecipeInfo objects specifically21:57
RPout datastore was never picklable directly21:57
JPEWGot it21:57
JPEWI couldn't quite figure out what change was making it so much bigger21:58
RPJPEW: in modern 3.x python with more knowledge in the minds of developers, we might be able to do something better but in 2.4 this was scary enough :)22:02
* JPEW face palms for trying to figure out what changes made the cache bigger by looking at master instead of RP's branch22:04
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 260 seconds)22:10
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto22:10
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has quit IRC (Quit: Leaving.)22:14
*** sakoman <sakoman!~steve@dhcp-72-253-6-214.hawaiiantel.net> has joined #yocto22:28
RPJPEW: 2.7s for loads() and 2.6s for add()22:29
RPJPEW: so I do see similar numbers22:29
JPEWYou can cut the add in half if you don't cache the dictionary keys; they don't actually appear to make a difference in the cache size22:30
JPEWAFAICT anyway22:30
JPEWLet me check again, maybe I had something else weird going on22:31
JPEWYa, doesn't appear to matter. I suspect they are unique enough you don't gain anything by caching them22:33
RPJPEW: I was meaning to see which bit was where the best effect was22:37
RPJPEW: I think that bit will be python version dependent on the internal string interning22:37
JPEWRP: Maybe; I don't think string interning is used when de-pickeling (not a compile time constant)22:38
JPEWRP: I think the rest of add is the conversion to frozensets now22:38
JPEW(with my micro-optimizing anyway)22:38
RPJPEW: I have https://git.yoctoproject.org/poky-contrib/commit/?h=rpurdie/t222&id=746d455a5ece241e950cf273012ecd33d62034a5 pending to try and be more consistent with the frozensets22:41
JPEWAH, ya that would help22:42
JPEWWell, or move the problem elsewhere ;)22:43
RPJPEW: well, we already create sets in the other places so I doubt it makes things much worse22:43
* RP was going to try and profile that in isolation22:43
JPEWIt seems to save a little bit of time22:46
RPJPEW: cool. It took me an age to debug where deps were coming from and that magic sorted()22:48
RPJPEW: https://git.yoctoproject.org/poky-contrib/commit/?h=rpurdie/t222&id=d93aab4f5f3dc5176edd87f4fd97c7ecbf74fb5f was my last experiment and about as fast as I could get it22:53
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Quit: Client closed)22:54
*** kanavin_ <kanavin_!~Alexander@2a02:2454:29b:3b00:d35d:e3cf:58b5:748b> has joined #yocto22:55
*** jsandman8 <jsandman8!~jsandman@95.179.203.88> has joined #yocto22:55
*** rhadye_ <rhadye_!sid217449@id-217449.tinside.irccloud.com> has joined #yocto22:56
*** ric96_ <ric96_!ric96@id-234506.helmsley.irccloud.com> has joined #yocto22:56
*** Net147_ <Net147_!~Net147@167-179-157-192.a7b39d.syd.nbn.aussiebb.net> has joined #yocto22:57
*** mrnuke_ <mrnuke_!~mrnuke@c-98-197-58-203.hsd1.tx.comcast.net> has joined #yocto22:57
*** eggman_ <eggman_!eggman@libera/staff/eggman> has joined #yocto22:57
*** yocton_ <yocton_!~quassel@2001:bc8:3386::1> has joined #yocto22:58
*** dlan_ <dlan_!~dennis@107.148.250.114> has joined #yocto22:59
*** zbr_ <zbr_!zibri@shell.x20.se> has joined #yocto22:59
*** Vonter_ <Vonter_!~Vonter@user/vonter> has joined #yocto22:59
*** zkrx <zkrx!~slimshady@adsl-89-217-230-95.adslplus.ch> has quit IRC (Killed (NickServ (GHOST command used by zkrx_)))23:02
*** zkrx <zkrx!~slimshady@adsl-89-217-230-95.adslplus.ch> has joined #yocto23:03
*** ramacassis[m] <ramacassis[m]!~ramacassi@2001:470:69fc:105::2:1958> has quit IRC (*.net *.split)23:04
*** PascalBach[m] <PascalBach[m]!~bachpmatr@2001:470:69fc:105::1d3b> has quit IRC (*.net *.split)23:04
*** kiwi_29_[m] <kiwi_29_[m]!~msgboardp@2001:470:69fc:105::1:6699> has quit IRC (*.net *.split)23:04
*** Saur[m] <Saur[m]!~saur2000m@2001:470:69fc:105::dce> has quit IRC (*.net *.split)23:04
*** dlan <dlan!~dennis@gentoo/developer/dlan> has quit IRC (*.net *.split)23:04
*** kanavin <kanavin!~Alexander@2a02:2454:29b:3b00:d35d:e3cf:58b5:748b> has quit IRC (*.net *.split)23:04
*** rhadye <rhadye!sid217449@id-217449.tinside.irccloud.com> has quit IRC (*.net *.split)23:04
*** DvorkinDmitry <DvorkinDmitry!~dvorkin@5.167.98.73> has quit IRC (*.net *.split)23:04
*** Vonter <Vonter!~Vonter@user/vonter> has quit IRC (*.net *.split)23:04
*** Net147 <Net147!~Net147@user/net147> has quit IRC (*.net *.split)23:04
*** ric96 <ric96!ric96@helmsley.irccloud.com> has quit IRC (*.net *.split)23:04
*** mrnuke <mrnuke!~mrnuke@c-98-197-58-203.hsd1.tx.comcast.net> has quit IRC (*.net *.split)23:04
*** olof <olof!zibri@shell.x20.se> has quit IRC (*.net *.split)23:04
*** Ad0 <Ad0!~Ad0@93.124.245.194> has quit IRC (*.net *.split)23:04
*** jsandman <jsandman!~jsandman@95.179.203.88> has quit IRC (*.net *.split)23:04
*** eggman <eggman!eggman@libera/staff/eggman> has quit IRC (*.net *.split)23:04
*** yocton <yocton!~quassel@2001:bc8:3386::1> has quit IRC (*.net *.split)23:04
*** rhadye_ is now known as rhadye23:04
*** eggman_ is now known as eggman23:04
*** ric96_ is now known as ric9623:04
*** jsandman8 is now known as jsandman23:04
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #yocto23:05
*** Ad0 <Ad0!~Ad0@93.124.245.194> has joined #yocto23:05
*** kiwi_29_[m] <kiwi_29_[m]!~msgboardp@2001:470:69fc:105::1:6699> has joined #yocto23:10
*** DvorkinDmitry <DvorkinDmitry!~dvorkin@5.167.98.73> has joined #yocto23:11
*** PascalBach[m] <PascalBach[m]!~bachpmatr@2001:470:69fc:105::1d3b> has joined #yocto23:13
*** Saur[m] <Saur[m]!~saur2000m@2001:470:69fc:105::dce> has joined #yocto23:14
*** goliath <goliath!~goliath@user/goliath> has quit IRC (Quit: SIGSEGV)23:15
*** eLmankku <eLmankku!elmankku@hilla.kapsi.fi> has quit IRC (Ping timeout: 268 seconds)23:15
*** ramacassis[m] <ramacassis[m]!~ramacassi@2001:470:69fc:105::2:1958> has joined #yocto23:15
*** Nick13 <Nick13!~Nick@98.45.237.149> has joined #yocto23:17
*** Nick13 <Nick13!~Nick@98.45.237.149> has quit IRC (Client Quit)23:17
*** Tokamak_ <Tokamak_!~Tokamak@172.58.227.181> has joined #yocto23:22
*** Tokamak <Tokamak!~Tokamak@166.205.152.52> has quit IRC (Ping timeout: 248 seconds)23:23
*** eLmankku <eLmankku!elmankku@hilla.kapsi.fi> has joined #yocto23:25
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has quit IRC (Quit: The Lounge - https://thelounge.chat)23:46
*** Wouter0100 <Wouter0100!~Wouter010@entry.nbg.netvos.nl> has joined #yocto23:47
*** nemik <nemik!~nemik@207.237.248.190> has quit IRC (Ping timeout: 248 seconds)23:49
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has joined #yocto23:49
*** nemik <nemik!~nemik@162-245-20-117.PUBLIC.monkeybrains.net> has quit IRC (Ping timeout: 256 seconds)23:54
*** nemik <nemik!~nemik@207.237.248.190> has joined #yocto23:54
*** eLmankku <eLmankku!elmankku@hilla.kapsi.fi> has quit IRC (Ping timeout: 260 seconds)23:54
*** eLmankku <eLmankku!elmankku@hilla.kapsi.fi> has joined #yocto23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!