*** King_InuYasha <King_InuYasha!~King_InuY@fedora/ngompa> has quit IRC | 00:14 | |
*** rob_w <rob_w!~rob@unaffiliated/rob-w/x-1112029> has quit IRC | 00:29 | |
*** vineela <vineela!vtummala@nat/intel/x-yafkacitcjlehwxm> has quit IRC | 00:29 | |
mranostay | paulg: is it open mic night at #yocto? :) | 00:43 |
---|---|---|
*** chandana73 <chandana73!~ckalluri@149.199.62.129> has joined #yocto | 00:59 | |
*** vineela <vineela!~vtummala@134.134.137.77> has joined #yocto | 01:11 | |
*** mithro <mithro!sid24875@gateway/web/irccloud.com/x-offajywgaamxjvfx> has quit IRC | 01:14 | |
*** mdp <mdp!sid49840@gateway/web/irccloud.com/x-gwxithoexnenwppw> has quit IRC | 01:17 | |
*** yann|work <yann|work!~yann@91-170-159-152.subs.proxad.net> has quit IRC | 01:18 | |
*** marex-cloud <marex-cloud!sid137234@gateway/web/irccloud.com/x-mketfhvzkwjcgrel> has quit IRC | 01:18 | |
*** Tartarus <Tartarus!sid72705@gateway/web/irccloud.com/x-ablfoktwwjlcihof> has quit IRC | 01:21 | |
*** mdp <mdp!sid49840@gateway/web/irccloud.com/x-wubonrvoxhfwfogv> has joined #yocto | 01:22 | |
*** marex-cloud <marex-cloud!sid137234@gateway/web/irccloud.com/x-qbjhbrlcdxkgjyuo> has joined #yocto | 01:23 | |
*** Tartarus <Tartarus!sid72705@gateway/web/irccloud.com/x-udvyncwatlwcaobe> has joined #yocto | 01:23 | |
*** mithro <mithro!sid24875@gateway/web/irccloud.com/x-czmcypepklhdeynd> has joined #yocto | 01:24 | |
*** Sandrita <Sandrita!18ca2637@gateway/web/cgi-irc/kiwiirc.com/ip.24.202.38.55> has quit IRC | 01:53 | |
*** vineela1 <vineela1!~vtummala@134.134.139.76> has joined #yocto | 01:58 | |
*** vineela <vineela!~vtummala@134.134.137.77> has quit IRC | 01:58 | |
*** fl0v0 <fl0v0!~fvo@89.244.120.44> has joined #yocto | 02:08 | |
*** fl0v01 <fl0v01!~fvo@89.244.126.116> has quit IRC | 02:09 | |
paulg | mranostay, every day is open mic day on #yocto | 02:30 |
paulg | Just be glad it isn't karaoke. | 02:30 |
*** vineela1 <vineela1!~vtummala@134.134.139.76> has quit IRC | 02:41 | |
*** hpsy1 <hpsy1!~hpsy@85.203.15.51> has joined #yocto | 02:45 | |
*** hpsy <hpsy!~hpsy@85.203.15.51> has quit IRC | 02:46 | |
*** mattsm <mattsm!~mattsm@76-205-175-243.lightspeed.austtx.sbcglobal.net> has quit IRC | 03:29 | |
*** mattsm <mattsm!~mattsm@76-205-175-243.lightspeed.austtx.sbcglobal.net> has joined #yocto | 03:32 | |
*** chandana731 <chandana731!~ckalluri@149.199.62.129> has joined #yocto | 03:34 | |
*** chandana73 <chandana73!~ckalluri@149.199.62.129> has quit IRC | 03:35 | |
*** dreyna <dreyna!~dreyna@c-24-5-28-247.hsd1.ca.comcast.net> has quit IRC | 03:35 | |
*** SJH22 <SJH22!cb36ac32@tel3187175.lnk.telstra.net> has joined #yocto | 03:47 | |
SJH22 | Where are the different yocto variables just like ${ TOPDIR }? | 03:47 |
*** maudat <maudat!~moda@mtrlpq2848w-lp130-04-70-29-226-188.dsl.bell.ca> has quit IRC | 03:51 | |
SJH22 | I am looking for other known variables that I can use in my yocto for e.g. THISDIR. | 03:55 |
kergoth | oe-core/meta/conf/bitbake.conf defines most key ones. but there's no defintiive list, any recipe can use any recipe it wants. | 03:58 |
*** georgem_ <georgem_!~georgem@216.21.169.52> has quit IRC | 04:09 | |
*** mranostay <mranostay!~mranostay@pdpc/supporter/active/mranostay> has quit IRC | 04:11 | |
*** mranostay <mranostay!~mranostay@pdpc/supporter/active/mranostay> has joined #yocto | 04:12 | |
*** georgem_ <georgem_!~georgem@216.21.169.52> has joined #yocto | 04:13 | |
*** paulg <paulg!~paulg@135-23-37-86.cpe.pppoe.ca> has quit IRC | 04:27 | |
*** georgem__ <georgem__!~georgem@216.21.169.52> has joined #yocto | 04:31 | |
*** ericch <ericch!~ericch@pool-108-34-251-214.prvdri.fios.verizon.net> has joined #yocto | 04:33 | |
*** georgem_ <georgem_!~georgem@216.21.169.52> has quit IRC | 04:33 | |
*** georgem__ <georgem__!~georgem@216.21.169.52> has quit IRC | 04:39 | |
*** vineela <vineela!vtummala@nat/intel/x-cigpvlbpfaeunjps> has joined #yocto | 04:42 | |
*** sakoman <sakoman!~steve@rrcs-66-91-142-162.west.biz.rr.com> has quit IRC | 04:45 | |
*** thaytan <thaytan!~thaytan@180-150-69-32.b49645.syd.nbn.aussiebb.net> has quit IRC | 04:49 | |
*** thaytan <thaytan!~thaytan@180-150-69-32.b49645.syd.nbn.aussiebb.net> has joined #yocto | 04:50 | |
*** georgem__ <georgem__!~georgem@216.21.169.52> has joined #yocto | 04:55 | |
*** gtristan <gtristan!~tristanva@110.11.227.189> has quit IRC | 05:09 | |
*** agust <agust!~agust@p508b67ab.dip0.t-ipconnect.de> has joined #yocto | 05:14 | |
*** bluelightning <bluelightning!~paul@pdpc/supporter/professional/bluelightning> has quit IRC | 05:15 | |
*** khem <khem!~khem@unaffiliated/khem> has quit IRC | 05:16 | |
*** khem <khem!~khem@unaffiliated/khem> has joined #yocto | 05:22 | |
*** sgw <sgw!~sgw@134.134.139.76> has quit IRC | 05:44 | |
*** camus1 <camus1!~Instantbi@222.67.152.154> has joined #yocto | 05:44 | |
*** kaspter <kaspter!~Instantbi@222.67.152.154> has quit IRC | 05:45 | |
*** camus1 is now known as kaspter | 05:45 | |
*** jofr <jofr!~jof@0x934e1f24.cust.fastspeed.dk> has left #yocto | 05:56 | |
*** gtristan <gtristan!~tristanva@110.11.227.177> has joined #yocto | 06:13 | |
*** kaspter <kaspter!~Instantbi@222.67.152.154> has quit IRC | 06:14 | |
*** kaspter <kaspter!~Instantbi@222.67.152.154> has joined #yocto | 06:15 | |
*** AndersD <AndersD!~AndersD@h-98-128-162-82.NA.cust.bahnhof.se> has joined #yocto | 06:15 | |
*** rcoote <rcoote!~rcoote@5.146.198.51> has joined #yocto | 06:23 | |
*** pohly <pohly!~pohly@p5b05684a.dip0.t-ipconnect.de> has joined #yocto | 06:34 | |
*** camus1 <camus1!~Instantbi@222.70.81.217> has joined #yocto | 06:39 | |
SJH22 | What are the different functions available in the yocto just like - do_compile_append? | 06:39 |
SJH22 | I am looking for the different functions available in the yocto just like do_compile_append()? | 06:39 |
*** kaspter <kaspter!~Instantbi@222.67.152.154> has quit IRC | 06:39 | |
*** camus1 is now known as kaspter | 06:39 | |
*** lfa <lfa!~lfa@80-108-132-46.cable.dynamic.surfer.at> has joined #yocto | 06:49 | |
*** nameclash <nameclash!~nameclash@ip1f11b23e.dynamic.kabel-deutschland.de> has joined #yocto | 06:52 | |
*** mckoan|away is now known as mckoan | 06:55 | |
mckoan | SJH22: those 'functions' are called tasks, see here https://www.openembedded.org/wiki/List_of_Executable_tasks | 06:58 |
mckoan | https://www.yoctoproject.org/docs/current/dev-manual/dev-manual.html#extendpoky | 07:00 |
*** leon-anavi <leon-anavi!~Leon@78.130.197.211> has joined #yocto | 07:17 | |
*** lfa <lfa!~lfa@80-108-132-46.cable.dynamic.surfer.at> has quit IRC | 07:20 | |
*** rabbit9911 <rabbit9911!34191729@ec2-52-25-23-41.us-west-2.compute.amazonaws.com> has quit IRC | 07:27 | |
*** andycooper <andycooper!uid246432@gateway/web/irccloud.com/x-ostirxbgxbptvsam> has quit IRC | 07:29 | |
*** yann|work <yann|work!~yann@91-170-159-152.subs.proxad.net> has joined #yocto | 07:32 | |
*** NiksDev <NiksDev!~NiksDev@192.91.101.31> has quit IRC | 07:32 | |
*** NiksDev <NiksDev!~NiksDev@192.91.101.32> has joined #yocto | 07:33 | |
maaathieu3a | quit | 07:38 |
*** maaathieu3a <maaathieu3a!~mathieu@92-111-78-37.static.v4.ziggozakelijk.nl> has quit IRC | 07:39 | |
*** AndersD <AndersD!~AndersD@h-98-128-162-82.NA.cust.bahnhof.se> has quit IRC | 07:52 | |
*** georgem_home <georgem_home!uid210681@gateway/web/irccloud.com/x-hhlzozkhqwclvryz> has quit IRC | 08:05 | |
*** guest37 <guest37!c5eec01a@197.238.192.26> has joined #yocto | 08:12 | |
guest37 | where can I find the generated Kconfig file to see what is build into my kernel ? | 08:12 |
*** kaspter <kaspter!~Instantbi@222.70.81.217> has quit IRC | 08:17 | |
*** camus1 <camus1!~Instantbi@222.70.81.228> has joined #yocto | 08:17 | |
*** camus1 is now known as kaspter | 08:19 | |
*** SJH22 <SJH22!cb36ac32@tel3187175.lnk.telstra.net> has quit IRC | 08:31 | |
*** rcoote <rcoote!~rcoote@5.146.198.51> has quit IRC | 08:39 | |
mckoan | guest37: bitbake -e virtual/kernel | grep ^B= | 08:45 |
guest37 | mckoan thanks ! where can I find a list of bitbake commands like this that might help me out ? | 08:47 |
[Sno] | RP: I have the perl install / clean loop running for 2 days meanwhile - different architectures, EWONTFAIL :( | 08:49 |
mckoan | guest37: https://wiki.koansoftware.com/index.php/Bitbake_options | 08:49 |
*** hpsy1 <hpsy1!~hpsy@85.203.15.51> has quit IRC | 08:51 | |
guest37 | mckoan thanks bro! | 08:52 |
*** florian_kc <florian_kc!~florian_k@Maemo/community/contributor/florian> has joined #yocto | 09:07 | |
*** guest37 <guest37!c5eec01a@197.238.192.26> has quit IRC | 09:20 | |
*** goliath <goliath!~goliath@clnet-p04-043.ikbnet.co.at> has joined #yocto | 09:47 | |
*** vineela <vineela!vtummala@nat/intel/x-cigpvlbpfaeunjps> has quit IRC | 09:49 | |
*** falstaff <falstaff!~quassel@2a02:169:3df5::509> has joined #yocto | 09:54 | |
*** rob_w <rob_w!~rob@unaffiliated/rob-w/x-1112029> has joined #yocto | 09:57 | |
*** rcoote <rcoote!~rcoote@2a02:908:694:300:50bf:6459:a225:8825> has joined #yocto | 10:14 | |
*** florian_kc is now known as florian | 10:17 | |
*** kroon <kroon!~kroon@213.185.29.22> has joined #yocto | 10:32 | |
RP | [Sno]: typical :(. I wish we could understand what is needed to reproduce :/ | 10:33 |
RP | [Sno]: I appreciate the effort trying. Together all these intermittent fails are a real pain :( | 10:33 |
*** bluelightning <bluelightning!~paul@pdpc/supporter/professional/bluelightning> has joined #yocto | 10:35 | |
[Sno] | RP: let's keep watching it - maybe we know better what external circumstances trigger it | 10:36 |
[Sno] | e.g. - all my build systems use ext4 on attached mass storage (hdd, ssd) - no network file system or ccache or distcc | 10:36 |
RP | [Sno]: right, all we can do really | 10:36 |
RP | [Sno]: its probably system load dependent | 10:37 |
[Sno] | Hmm, maybe - I use one buildjob per host and ncpus*2 make-jobs and ncpus*2 bitbake tasks | 10:39 |
*** jofr <jofr!~jof@0x934e1f24.cust.fastspeed.dk> has joined #yocto | 11:13 | |
*** ant_home <ant_home!~ant__@host-87-0-248-218.retail.telecomitalia.it> has quit IRC | 11:21 | |
*** ant_home <ant_home!~ant__@host-87-2-158-177.retail.telecomitalia.it> has joined #yocto | 11:23 | |
*** nerdboy <nerdboy!~sarnold@gentoo/developer/nerdboy> has quit IRC | 11:26 | |
*** [Sno] <[Sno]!~sno@p4fe931fc.dip0.t-ipconnect.de> has quit IRC | 11:27 | |
*** Bunio_FH <Bunio_FH!~bunio@81-18-201-214.static.chello.pl> has quit IRC | 11:38 | |
*** berton <berton!~berton@181.220.84.90> has joined #yocto | 11:42 | |
*** radsquirrel <radsquirrel!~radsquirr@mail.fuzziesquirrel.com> has quit IRC | 11:45 | |
*** bluelightning <bluelightning!~paul@pdpc/supporter/professional/bluelightning> has quit IRC | 11:46 | |
*** radsquirrel <radsquirrel!~radsquirr@mail.fuzziesquirrel.com> has joined #yocto | 11:47 | |
*** berton <berton!~berton@181.220.84.90> has quit IRC | 11:47 | |
*** Dracos-Carazza <Dracos-Carazza!~Dracos-Ca@ip4d154318.dynamic.kabel-deutschland.de> has quit IRC | 11:49 | |
*** Dracos-Carazza <Dracos-Carazza!~Dracos-Ca@ip4d154318.dynamic.kabel-deutschland.de> has joined #yocto | 11:49 | |
*** berton <berton!~berton@181.220.84.90> has joined #yocto | 11:50 | |
*** Bunio_FH <Bunio_FH!~bunio@81-18-201-214.static.chello.pl> has joined #yocto | 11:53 | |
*** georgem_home <georgem_home!uid210681@gateway/web/irccloud.com/x-dyoalzosspkispji> has joined #yocto | 11:53 | |
*** paulg <paulg!~paulg@135-23-37-86.cpe.pppoe.ca> has joined #yocto | 11:53 | |
paulbarker | RP: Is the test_yocto_source_mirror failure blocking anything? | 11:57 |
RP | paulbarker: its causing all autobuilder tests to fail atm | 12:01 |
RP | not "blocking" but serious as we can't get a green build | 12:01 |
rburton | anyone managed to build gccgo? | 12:02 |
paulbarker | RP: ok, let me see what I can do this afternoon. Got an idea where the issue lies | 12:02 |
rburton | I just get | ../../../../../../../../work-shared/gcc-10.1.0-r0/gcc-10.1.0/libgcc/../gcc/tsystem.h:87:10: fatal error: stdio.h: No such file or directory | 12:02 |
RP | paulbarker: thanks. If you don't have time at least share the hints as I'll probably have to look into it | 12:03 |
paulbarker | RP: Will do | 12:04 |
*** m1ster_r0b0t <m1ster_r0b0t!~m1ster_r0@80-110-44-28.static.upcbusiness.at> has quit IRC | 12:09 | |
*** m1ster_r0b0t <m1ster_r0b0t!~m1ster_r0@80-110-44-28.static.upcbusiness.at> has joined #yocto | 12:14 | |
*** gtristan <gtristan!~tristanva@110.11.227.177> has quit IRC | 12:20 | |
*** flampy <flampy!74498554@116.73.133.84> has joined #yocto | 12:25 | |
flampy | Hello, I am trying to use http://downloads.yoctoproject.org/releases/yocto/yocto-1.8/machines/qemu/qemux86/core-image-sato-sdk-qemux86.ext4 image in a qemu vm. This image has gcc, make, etc. but not cmake. Also when trying to use dnf it doesn't work because there are no repositories. I tried searching for repositories, but didn't find any. How do I | 12:28 |
flampy | install cmake on yocto? | 12:28 |
flampy | Other methods suggest building the image on my own and adding a layer that contains cmake as far as I understand. But I'd like to avoid that. Is any other way possible which doesn't require me compiling the image myself? | 12:30 |
mckoan | flampy: https://stackoverflow.com/questions/41964891/yocto-sdk-with-cmake-toolchain-file | 12:38 |
mckoan | or if you need cmake in the target image add in local.conf IMAGE_INSTALL_append = " cmake" | 12:42 |
flampy | mckoan: isn't the method suggested in that stackoverflow answer also require me building the image from source unlike downloading the one from the website? | 12:42 |
mckoan | flampy: yes sorry, I didn0t notice that you were using a prebuilt image | 12:44 |
mckoan | flampy: so you have to rebuild the image | 12:46 |
paulbarker | flampy: What is your use case for that image? It's an old release which is no longer supported and in general Yocto Project is about building images yourself from source | 12:50 |
flampy | paulbarker: I am using it as rootfs for qemu which I am using as a kernel development environment | 12:53 |
flampy | similar to this : https://linux-kernel-labs.github.io/refs/heads/master/info/vm.html?highlight=sato | 12:53 |
*** maudat <maudat!~moda@mtrlpq2848w-lp130-04-70-29-226-188.dsl.bell.ca> has joined #yocto | 12:53 | |
paulbarker | flampy: I think those instructions are pointing you in the wrong direction. There are other, much better options for a VM image in which to do kernel development | 12:56 |
paulbarker | flampy: Choose your favourite Linux distro and run that in a VM instead | 12:56 |
*** kroon <kroon!~kroon@213.185.29.22> has quit IRC | 13:03 | |
flampy | paulbarker: I see, hmm. For more context, I am using yocto to act as host pc for a dsp emulator. | 13:06 |
flampy | architecture diagram : https://www.alsa-project.org/main/images/4/4e/Heterogeneous-vm.png | 13:06 |
flampy | wiki : https://www.alsa-project.org/wiki/Firmware section "Using the Qemu DSP emulator" | 13:06 |
flampy | so maybe there might be relevance in using yocto since i read from website it is used in embedded systems, etc. I am a student trying to contribute to this firmware and getting acquainted with the setup. | 13:07 |
*** crazoes[m]1 <crazoes[m]1!crazoesmat@gateway/shell/matrix.org/x-uxinrjqhvwpztvow> has joined #yocto | 13:22 | |
*** flampy <flampy!74498554@116.73.133.84> has quit IRC | 13:22 | |
*** dlan <dlan!~dennis@gentoo/developer/dlan> has quit IRC | 13:46 | |
*** dlan <dlan!~dennis@116.226.129.133> has joined #yocto | 13:47 | |
*** dlan <dlan!~dennis@gentoo/developer/dlan> has joined #yocto | 13:47 | |
*** Sandrita <Sandrita!18ca2637@gateway/web/cgi-irc/kiwiirc.com/ip.24.202.38.55> has joined #yocto | 13:55 | |
paulbarker | RP: I found the issue, may need a bit of a sanity check on how to resolve it | 13:56 |
paulbarker | git-submodule-test has bitbake as a submodule twice with different commits. The fetcher runs for each instance. On the first instance it's downloaded correctly | 13:57 |
paulbarker | On the second instance ud.clonedir already exists so try_premirror returns False and pre-mirrors aren't even tried | 13:58 |
paulbarker | https://git.openembedded.org/bitbake/tree/lib/bb/fetch2/git.py#n321 | 13:58 |
paulbarker | As pre-mirrors are skipped it goes straight to checking upstream and fails out as it's an untrusted URL in this test | 13:59 |
paulbarker | https://git.openembedded.org/bitbake/tree/lib/bb/fetch2/__init__.py#n1703 | 13:59 |
fray | There are definitely repositories out there that list the same URL with different commits for different checkout locations. So the test sounds valid, but the behavior doesn't. | 14:00 |
paulbarker | There's two ways to fix it | 14:00 |
fray | What I THOUGHT was happening (at least in the past) it would check the local downloads, see that the commit was or was not present, and then proceed through the premirrors, upstream, mirrors. I thought that had been working in the past. | 14:01 |
paulbarker | 1) Fix it in the gitsm fetcher, in needs_update() we can check if the desired commit is present instead of just checking the bitbake.srcrev config option | 14:01 |
*** King_InuYasha <King_InuYasha!~King_InuY@fedora/ngompa> has joined #yocto | 14:01 | |
*** sakoman <sakoman!~steve@rrcs-66-91-142-162.west.biz.rr.com> has joined #yocto | 14:01 | |
fray | The gitsm fetcher should be calling the git fetcher (it was in the past) to do that validation. Perhaps that got dropped, or there is another corner case that was missed | 14:01 |
paulbarker | fray: It won't look at the local downloads unless the download method actually gets called. Premirrors is the first opportunity for that | 14:01 |
fray | Ya, the download method itself shold be called for each of the submodules, even if it's a directory that already exists.. (need to know if it's been processed or not) | 14:02 |
paulbarker | Git.download() isn't being called at all for the second instance as premirrors are skipped | 14:02 |
paulbarker | The other possible fix... (2) fix Git.try_premirrors() so that it doesn't return False if the clonedir already exists | 14:03 |
fray | gitsm itself shouldn't have any knowledge of any premirrors, mirrors, etc.. | 14:03 |
paulbarker | I'm not sure on what other impacts changing Git.try_premirrors() behaviour will have though | 14:03 |
fray | it was intended to -always- call git itself, which has that knowledge | 14:03 |
*** Sandrita <Sandrita!18ca2637@gateway/web/cgi-irc/kiwiirc.com/ip.24.202.38.55> has quit IRC | 14:04 | |
paulbarker | fray: That's correct | 14:04 |
fray | try: | 14:04 |
fray | # Check for the nugget dropped by the download operation | 14:04 |
fray | known_srcrevs = runfetchcmd("%s config --get-all bitbake.srcrev" % \ | 14:04 |
fray | (ud.basecmd), d, workdir=ud.clonedir) | 14:04 |
fray | if ud.revisions[ud.names[0]] not in known_srcrevs.split(): | 14:04 |
fray | return True | 14:04 |
fray | thats what need_update should be doing here.. | 14:04 |
fray | and why git.need_update is called just prior | 14:04 |
paulbarker | fray: That's solution (1) of the 2 I said above | 14:05 |
fray | Ok, then I don't understand what isn't right then.. | 14:05 |
paulbarker | Are you saying Git.try_premirrors() is behaving correctly and we should fix this in Gitsm.need_update() | 14:05 |
fray | No, I'm saying that gitsm looks right to me. So any bugs would be in git fetcher. | 14:06 |
paulbarker | Ok | 14:06 |
fray | Do we have any tests for the situation where you have two recipes both pointing to the same git repository but different commit ids (same thing as what gitsm is doing, but at a recipe level instead of a submodule level) | 14:07 |
paulbarker | fray: We do now and it's failing | 14:07 |
paulbarker | Oh no | 14:07 |
paulbarker | Sorry | 14:07 |
paulbarker | At a recipe level I'm not sure there's an individual test but it shouldn't fail | 14:07 |
paulbarker | The issue here is caused by Gitsm for sure | 14:07 |
fray | I -think- I've seen issues in the past with two individual recipes pointing to the same upstream src_uri but different srcrev that have had problems, but I'd never been able to fully track it down | 14:08 |
paulbarker | Maybe I just need to explain it better | 14:08 |
fray | So what th system should be doing (gitsm) at a high level is simply iterating (recursively) over each submodule it finds. Each iteration is a 'new' feetch (recusive call back to gitsm, which in turn calls git fetcher function) | 14:08 |
fray | So theoretically it should work in exactly the same way as if someone had specified individual src uris and srcrevs instead of using gitsm. | 14:09 |
paulbarker | fray: I'll walk through what's happening | 14:09 |
paulbarker | For our second instance of the same source repo, Gitsm.needs_update() looks for the bitbake.srcrev 'nugget' set by the download operation. That contains the srcrev used by the first instance but does not yet contain the srcrev we want so it returns True (it needs updating) | 14:10 |
paulbarker | The fetcher then calls the try_premirrors() function on that fetch instance. As Gitsm doesn't override that it falls to Git.try_premirrors() which returns False as the clonedir is already there | 14:11 |
paulbarker | So the fetcher doesn't try any premirrors. The download method doesn't actually get called at all | 14:11 |
fray | ok.. so git.try_premirror is only looking for the clonedir and not the contents? | 14:11 |
paulbarker | It then proceeds to trying upstream but bails out as upstream is not a trusted URL in this test | 14:11 |
paulbarker | fray: Correct | 14:11 |
fray | gotcha.. ya, I'd say the bug is git.try_premirror. It should be verifying what is present has the commit | 14:12 |
paulbarker | fray: If it did that, it would see the commit is there and return False. But Gitsm wouldn't see it as bitbake.srcrev hasn't been set with that commit yet | 14:12 |
paulbarker | I think Gitsm.needs_update() should be checking if the actual commit is there not looking for some proxy bitbake.srcrev value | 14:13 |
paulbarker | And maybe Git.try_premirrors() also needs modifying to return True if the clonedir is present but lacks the correct commit | 14:14 |
fray | Ya, I get what you are saying, but I'm still not sure I understand.. | 14:14 |
fray | My understanding of try_premirrors is it had two states.. either it downloaded something (or it's present) or it didn't.. true/false.. | 14:15 |
fray | in the first case, the thing is present, and should just 'work' then | 14:15 |
fray | as for the 'nugget' that was added, I need to look at the git logs.. I know this was added tos pecifically to avoid a pathelogical case | 14:16 |
*** mnemoc <mnemoc!~amery@geeks.cl> has joined #yocto | 14:16 | |
paulbarker | fray: Ok | 14:16 |
fray | See (poky) 2030e815bb1ba932c58b0c9318f97602fdd4edfb or bitbake 30fe86d22c239afa75168cc5eb262b880886ef8a | 14:17 |
fray | the problem we were having is that we can't actually look into the download contents in the need_update, because things can run in parallel and we were having race issues.. locking was inconsistent. | 14:18 |
RP | paulbarker: I think that try_premirror in the git fetcher needs to call clonedir_need_update in that exists() call | 14:18 |
paulbarker | fray: That makes perfect sense now | 14:18 |
RP | paulbarker: I'd try that and see if that breaks the tests | 14:18 |
fray | So instead what we're doing is we should be caching everything we've iterated so that we know if we have to have the git fetcher 'try' | 14:18 |
*** stephano <stephano!~stephano@c-73-164-244-205.hsd1.or.comcast.net> has joined #yocto | 14:18 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 14:19 | |
*** nameclash <nameclash!~nameclash@ip1f11b23e.dynamic.kabel-deutschland.de> has quit IRC | 14:19 | |
RP | I think the git fetcher behaviour with premirrors is a little deliberate though, if we had a clone, try and update it rather than pulling more from the premirror :/ | 14:20 |
RP | I'm not sure its right or can work like that though | 14:20 |
fray | Hmm.. ya cause updting something will fail if we can't or are not allowed to access the upstream | 14:21 |
paulbarker | RP: fray: Sounds like the Gitsm fetcher needs to be able to recurse over the submodules to see if the correct commits are present locally before we try premirrors | 14:23 |
JPEW | Hmm, openssl-native seems to be broken on dunfell | 14:23 |
RP | paulbarker: ah, possibly | 14:24 |
paulbarker | RP: Basically make Gitsm.need_update() recurse through the submodules and add the bitbake.srcrev values if the commits are present | 14:25 |
paulbarker | Then return True if it's found every commit is already present | 14:25 |
RP | paulbarker: I've gotten a bit lost along the way but that sounds right (I think you mean False?). | 14:26 |
paulbarker | RP: Yes. You're right | 14:26 |
paulbarker | It's easy to get a bit lost in it. I'll try implementing that and see what happens | 14:27 |
RP | paulbarker: this is why I started writing fetcher test cases... | 14:32 |
*** sno <sno!~sno@195.14.209.36> has joined #yocto | 14:35 | |
*** ibinderwolf <ibinderwolf!~quassel@etrn.topcontrol.it> has quit IRC | 14:38 | |
*** sgw <sgw!sgw@nat/intel/x-uvykzejpnhlhiprd> has joined #yocto | 14:38 | |
*** sakoman <sakoman!~steve@rrcs-66-91-142-162.west.biz.rr.com> has quit IRC | 14:39 | |
*** sakoman <sakoman!~steve@rrcs-66-91-142-162.west.biz.rr.com> has joined #yocto | 14:42 | |
*** Sandrita <Sandrita!d0586e2e@gateway/web/cgi-irc/kiwiirc.com/ip.208.88.110.46> has joined #yocto | 14:48 | |
*** amerigo <amerigo!uid331857@gateway/web/irccloud.com/x-zwahwlppilwljclj> has joined #yocto | 14:49 | |
*** TobSnyder <TobSnyder!~schneider@p2e50e9c2.dip0.t-ipconnect.de> has joined #yocto | 15:11 | |
*** armpit <armpit!~armpit@2601:202:4180:a5c0:8db7:61a4:bc7:9403> has quit IRC | 15:16 | |
JPEW | Ok, sorry, openssl-native isn't broken on the latest dunfell. Openssl 1.1.1g work, Openssl 1.1.1f is broken | 15:20 |
*** andycooper <andycooper!uid246432@gateway/web/irccloud.com/x-xxiimfeycdzjjphd> has joined #yocto | 15:28 | |
*** sno <sno!~sno@195.14.209.36> has quit IRC | 15:35 | |
*** sno <sno!~sno@195.14.209.36> has joined #yocto | 15:40 | |
*** chandana731 <chandana731!~ckalluri@149.199.62.129> has quit IRC | 15:41 | |
*** chandana73 <chandana73!~ckalluri@149.199.62.129> has joined #yocto | 15:43 | |
RP | JPEW: openssl is broken in buildtools-tarball if that helps? :) | 15:48 |
JPEW | RP: Heh, not really... I was seeing `openssl verify` fail to verify certificates with Openssl 1.1.1f, what wrong with the one in buildtools-tarball? | 15:50 |
*** leon-anavi <leon-anavi!~Leon@78.130.197.211> has quit IRC | 15:51 | |
RP | JPEW: environment isn't set to account for the relocation. sakoman has a patch coming | 15:52 |
*** nameclash <nameclash!~nameclash@ip1f11b23e.dynamic.kabel-deutschland.de> has joined #yocto | 15:53 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has quit IRC | 15:54 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 15:54 | |
RP | If anyone can spot a better way of doing rename detection in buildhistory please do send patches, I don't like mine... | 15:55 |
sakoman | Just sent the buildtools-tarball patch | 15:57 |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has quit IRC | 16:02 | |
*** hipr_C <hipr_C!~Thunderbi@89.187.178.4> has quit IRC | 16:05 | |
JPEW | RP: You could do what git does and diff the files to calculate a similarity index | 16:05 |
JPEW | If they are less than 50% difference, its the same file, just renamed | 16:06 |
*** shoragan_ is now known as shoragan | 16:08 | |
RP | JPEW: we don't have the files, just lists | 16:09 |
*** florian <florian!~florian_k@Maemo/community/contributor/florian> has quit IRC | 16:12 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 16:15 | |
*** armpit <armpit!~armpit@2601:202:4180:a5c0:5030:aa9f:23eb:a3d9> has joined #yocto | 16:15 | |
*** asteriusio <asteriusio!~derek@104-179-196-18.lightspeed.brhmal.sbcglobal.net> has quit IRC | 16:19 | |
*** asteriusio <asteriusio!~derek@104-179-196-18.lightspeed.brhmal.sbcglobal.net> has joined #yocto | 16:19 | |
*** mckoan is now known as mckoan|away | 16:25 | |
*** mauz555 <mauz555!~mauz555@2a01:e0a:56d:9090:4119:c5:9d6c:d2f5> has joined #yocto | 16:30 | |
*** rcoote <rcoote!~rcoote@2a02:908:694:300:50bf:6459:a225:8825> has quit IRC | 16:35 | |
JPEW | RP: Ah, OK | 16:38 |
*** mranostay <mranostay!~mranostay@pdpc/supporter/active/mranostay> has quit IRC | 16:39 | |
*** mranostay <mranostay!~mranostay@pdpc/supporter/active/mranostay> has joined #yocto | 16:47 | |
*** gtristan <gtristan!~tristanva@110.11.227.189> has joined #yocto | 16:59 | |
*** nerdboy <nerdboy!~sarnold@47.143.129.23> has joined #yocto | 17:14 | |
*** nerdboy <nerdboy!~sarnold@gentoo/developer/nerdboy> has joined #yocto | 17:14 | |
*** sno <sno!~sno@195.14.209.36> has quit IRC | 17:26 | |
*** vineela <vineela!vtummala@nat/intel/x-pzalirhhbvqgyrlw> has joined #yocto | 17:29 | |
*** rcoote <rcoote!~rcoote@2a02:908:694:300:c817:8c35:91cc:9615> has joined #yocto | 17:37 | |
*** rcoote <rcoote!~rcoote@2a02:908:694:300:c817:8c35:91cc:9615> has quit IRC | 17:41 | |
paulbarker | RP: I'm pretty sure I have a fix, going to re-run all the tests before submitting it | 17:56 |
paulbarker | There's room for some refactoring & clean up in the gitsm fetcher but I'll come back to that another day | 17:57 |
*** sno <sno!~sno@p4fe931fc.dip0.t-ipconnect.de> has joined #yocto | 18:12 | |
RP | paulbarker: sounds great, thanks! | 18:13 |
RP | paulbarker: getting the autobuilder happy again is a huge help | 18:13 |
paulbarker | RP: bitbake-selftest is happy with the exception of a few hashserv tests failing because of an ipv6 issue, that will be unrelated to my changes. Now for oe-selftest | 18:15 |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has quit IRC | 18:17 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 18:23 | |
*** rabbit9911 <rabbit9911!34191729@ec2-52-25-23-41.us-west-2.compute.amazonaws.com> has joined #yocto | 18:24 | |
*** jkridner|pd <jkridner|pd!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 18:24 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has quit IRC | 18:24 | |
RP | paulbarker: I'd imagine if bitbake-selftest is good that will have stressed anything in that codepath. I'm happy to take into -next for the oe-selftests | 18:33 |
RP | paulbarker: those will take a while :/ | 18:34 |
*** jkridner|pd <jkridner|pd!~jkridner@pdpc/supporter/active/jkridner> has quit IRC | 18:34 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 18:34 | |
*** gnac <gnac!~gnac@or-71-0-52-80.sta.embarqhsd.net> has joined #yocto | 18:39 | |
*** mauz555 <mauz555!~mauz555@2a01:e0a:56d:9090:4119:c5:9d6c:d2f5> has quit IRC | 18:48 | |
*** sagner <sagner!~ags@37.17.234.113> has quit IRC | 18:51 | |
*** sagner <sagner!~ags@2a02:169:3df5::edf> has joined #yocto | 18:52 | |
*** falstaff <falstaff!~quassel@2a02:169:3df5::509> has quit IRC | 18:53 | |
*** falstaff_ <falstaff_!~quassel@2a02:169:3df5::509> has joined #yocto | 18:53 | |
*** ecdhe <ecdhe!~quassel@unaffiliated/ecdhe> has quit IRC | 18:56 | |
paulbarker | RP: Ok, let me write some commit messages and send the patches | 18:59 |
*** gnac <gnac!~gnac@or-71-0-52-80.sta.embarqhsd.net> has quit IRC | 19:03 | |
*** sakoman <sakoman!~steve@rrcs-66-91-142-162.west.biz.rr.com> has quit IRC | 19:06 | |
*** sagner <sagner!~ags@2a02:169:3df5::edf> has quit IRC | 19:07 | |
*** sagner <sagner!~ags@2a02:169:3df5::587> has joined #yocto | 19:07 | |
*** gnac <gnac!~gnac@or-71-0-52-80.sta.embarqhsd.net> has joined #yocto | 19:09 | |
*** chandana73 <chandana73!~ckalluri@149.199.62.129> has quit IRC | 19:10 | |
*** matthewzmd <matthewzmd!~user@CPEbc4dfb562ea3-CMbc4dfb562ea0.cpe.net.fido.ca> has joined #yocto | 19:15 | |
paulbarker | RP: Patches sent. Let's see what the autobuilder thinks | 19:16 |
*** vineela <vineela!vtummala@nat/intel/x-pzalirhhbvqgyrlw> has quit IRC | 19:16 | |
*** BobPungartnik <BobPungartnik!~BobPungar@2804:7f0:a081:63e1:4935:4421:c8bd:9407> has joined #yocto | 19:19 | |
*** gnac <gnac!~gnac@or-71-0-52-80.sta.embarqhsd.net> has quit IRC | 19:21 | |
*** vineela <vineela!vtummala@nat/intel/x-kqkypqtymruiczrl> has joined #yocto | 19:22 | |
*** sakoman <sakoman!~steve@rrcs-66-91-142-162.west.biz.rr.com> has joined #yocto | 19:25 | |
RP | paulbarker: thanks | 19:25 |
*** matthewzmd is now known as mzeng | 19:30 | |
*** mzeng is now known as matthewzmd | 19:31 | |
*** stephano <stephano!~stephano@c-73-164-244-205.hsd1.or.comcast.net> has quit IRC | 19:45 | |
*** falstaff_ <falstaff_!~quassel@2a02:169:3df5::509> has quit IRC | 19:48 | |
*** NiksDev <NiksDev!~NiksDev@192.91.101.32> has quit IRC | 20:12 | |
*** NiksDev <NiksDev!~NiksDev@192.91.75.12> has joined #yocto | 20:12 | |
*** mihai- <mihai-!~mihai@unaffiliated/mihai> has quit IRC | 20:29 | |
*** kroon <kroon!~kroon@37-247-29-68.customers.ownit.se> has joined #yocto | 20:41 | |
*** vineela <vineela!vtummala@nat/intel/x-kqkypqtymruiczrl> has quit IRC | 20:46 | |
*** kroon <kroon!~kroon@37-247-29-68.customers.ownit.se> has quit IRC | 20:49 | |
*** pohly <pohly!~pohly@p5b05684a.dip0.t-ipconnect.de> has quit IRC | 21:04 | |
*** matthewzmd <matthewzmd!~user@CPEbc4dfb562ea3-CMbc4dfb562ea0.cpe.net.fido.ca> has left #yocto | 21:06 | |
*** vineela <vineela!vtummala@nat/intel/x-nembnchougovqytr> has joined #yocto | 21:10 | |
*** aidanh <aidanh!~aidanh@unaffiliated/aidanh> has quit IRC | 21:14 | |
*** berton <berton!~berton@181.220.84.90> has quit IRC | 21:16 | |
*** aidanh <aidanh!~aidanh@unaffiliated/aidanh> has joined #yocto | 21:16 | |
*** maudat <maudat!~moda@mtrlpq2848w-lp130-04-70-29-226-188.dsl.bell.ca> has quit IRC | 21:17 | |
*** rabbit9911 <rabbit9911!34191729@ec2-52-25-23-41.us-west-2.compute.amazonaws.com> has quit IRC | 21:18 | |
*** vineela <vineela!vtummala@nat/intel/x-nembnchougovqytr> has quit IRC | 21:47 | |
*** agust <agust!~agust@p508b67ab.dip0.t-ipconnect.de> has quit IRC | 23:20 | |
*** jkridner|pd <jkridner|pd!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto | 23:23 | |
*** jkridner <jkridner!~jkridner@pdpc/supporter/active/jkridner> has quit IRC | 23:23 | |
*** TobSnyder <TobSnyder!~schneider@p2e50e9c2.dip0.t-ipconnect.de> has quit IRC | 23:34 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!