Monday, 2019-07-08

*** stryx` <stryx`!~stryx@unaffiliated/stryx/x-3871776> has joined #yocto00:09
*** jkridner|pd <jkridner|pd!~jkridner@pdpc/supporter/active/jkridner> has joined #yocto00:23
*** justanotherboy <justanotherboy!~justanoth@> has joined #yocto01:46
*** awe00 <awe00!~awe00@unaffiliated/awe00> has quit IRC02:09
*** Ad0 <Ad0!~Ad0@> has quit IRC02:44
*** Ad0 <Ad0!~Ad0@> has joined #yocto02:54
*** OnkelUlla <OnkelUlla!> has joined #yocto03:05
*** vladzouth <vladzouth!> has quit IRC03:25
*** akrpic77 <akrpic77!c12e4b03@> has quit IRC03:38
*** nerdboy <nerdboy!~sarnold@gentoo/developer/nerdboy> has quit IRC03:48
*** justanotherboy <justanotherboy!~justanoth@> has quit IRC03:55
*** luckywho_ <luckywho_!~quassel@> has joined #yocto04:05
*** fatalhalt <fatalhalt!> has quit IRC04:19
*** King_InuYasha <King_InuYasha!~King_InuY@fedora/ngompa> has quit IRC04:46
*** AndersD <AndersD!> has joined #yocto05:24
*** cvasilak <cvasilak!> has joined #yocto05:29
*** agust <agust!> has joined #yocto06:01
*** frsc <frsc!~frsc@2003:a:e7a:6200:246c:2a8b:f45a:a33d> has joined #yocto06:25
*** AndersD <AndersD!> has quit IRC06:37
*** mckoan|away is now known as mckoan06:51
mckoangood morning06:51
*** jmiehe <jmiehe!> has joined #yocto06:52
*** saraf <saraf!~a_saraf@> has joined #yocto07:03
*** woutervh <woutervh!~woutervh@> has joined #yocto07:03
*** saraf <saraf!~a_saraf@> has quit IRC07:04
*** rubdos_ <rubdos_!~rubdos@2a02:578:859d:701:a846:9858:21a:9451> has joined #yocto07:05
*** rubdos <rubdos!> has quit IRC07:05
*** tprrt <tprrt!~tprrt@> has joined #yocto07:06
*** AndersD <AndersD!> has joined #yocto07:11
*** rubdos_ is now known as rubdos07:13
*** Bunio_FH <Bunio_FH!> has joined #yocto07:17
*** rob_w <rob_w!~bob@unaffiliated/rob-w/x-1112029> has joined #yocto07:22
*** prabhakarlad <prabhakarlad!~prabhakar@> has joined #yocto07:23
*** yann <yann!> has quit IRC07:31
*** florian <florian!~florian_k@Maemo/community/contributor/florian> has joined #yocto07:31
*** mihai <mihai!~mihai@unaffiliated/mihai> has joined #yocto07:44
*** Hodhr <Hodhr!> has joined #yocto07:55
*** Hodhr <Hodhr!> has left #yocto07:55
*** milloni <milloni!> has quit IRC08:02
*** milloni <milloni!> has joined #yocto08:03
yoctiNew news from stackoverflow: Copy Yocto Project to other PC by tar <>08:03
*** bluca <bluca!~bluca@> has joined #yocto08:04
*** cvasilak <cvasilak!> has quit IRC08:10
*** T_UNIX <T_UNIX!uid218288@gateway/web/> has joined #yocto08:12
*** TobSnyder <TobSnyder!> has joined #yocto08:19
*** huynq <huynq!65607042@> has joined #yocto08:20
*** huynq <huynq!65607042@> has quit IRC08:35
*** yann <yann!~yann@> has joined #yocto08:42
*** BCMM <BCMM!~BCMM@unaffiliated/bcmm> has joined #yocto08:58
*** Net147 <Net147!~Net147@unaffiliated/net147> has quit IRC09:11
*** awe00 <awe00!~awe00@unaffiliated/awe00> has joined #yocto09:12
*** Net147 <Net147!~Net147@unaffiliated/net147> has joined #yocto09:18
mcfriskodd, I'm seeing lots of do_populate_sdk failures from my build after switch from sumo to master branch. any ideas why images do_populate_sdk task dependency to recipes do_package_write_ipk and do_packagedata would not be enough? packages fail to install in do_populate_sdk due to "opkg_prepare_url_for_install: Couldn't find anything to satisfy 'binary-package-name'"09:33
mcfriskthese errors only happen after wiping tmp, first build fails. second passes.09:34
*** bluelightning_ <bluelightning_!~paul@pdpc/supporter/professional/bluelightning> has joined #yocto09:36
*** AndersD_ <AndersD_!> has joined #yocto09:36
*** AndersD <AndersD!> has quit IRC09:37
*** bluelightning <bluelightning!~paul@pdpc/supporter/professional/bluelightning> has quit IRC09:40
*** rburton <rburton!> has joined #yocto09:43
mcfriskis populate_sdk_base.bbclass maybe missing dependencies: do_populate_sdk[recrdeptask] += "do_populate_lic do_package_qa" ?09:47
mcfriskbecause do_rootfs tasks have these but do_populate_sdk doesn't09:47
__angelofor a new ditribution, where is the proper place to keep the local.conf ?09:50
__angelooe-init-build-env complains about   templateconf: No such file or directory09:51
*** kaspter <kaspter!~Instantbi@> has quit IRC11:03
*** kaspter <kaspter!~Instantbi@> has joined #yocto11:11
rburtonlocal.conf is - by definition - not your distribution11:23
rburtonthe distro config is called <your distro name>.conf11:23
rburtonthe distro layer can also ship a setup script and template to seed a local.conf which sets DISTRO correctly, just like poky does11:24
rburtonor if you want a really lean example,
weltlingwhat could be an approach to have a legacy grub integrated into the build process? There's a doc about doing it manually, so i guess one would need to implement a wic plugin or a custom class to automate this?11:34
*** berton <berton!~berton@> has joined #yocto11:41
*** berton <berton!~berton@> has quit IRC11:49
*** berton <berton!~berton@> has joined #yocto11:50
tgoodwinHas anyone seen "-mfloat-abi=hard" get set for qemuarm on thud?  I've dumped my environment but do not see where it's being set.  I'm not seeing it in temp either.  Very weird.12:07
*** bluelightning_ <bluelightning_!~paul@pdpc/supporter/professional/bluelightning> has quit IRC12:14
*** vmeson <vmeson!> has joined #yocto12:21
*** kitzin <kitzin!> has joined #yocto12:22
yoctiNew news from stackoverflow: Yocto Warrior Bitbake Python3 Matplotlib 3.1.1 JQuery Download Error on do_install <>12:34
*** chandana73 <chandana73!~ckalluri@> has joined #yocto12:43
jwesselRP: Do you know if it is possible to add a task hash dependency to another task?12:43
jwesselI was thinking about how to fix the do_stash_locale() patch problem for the future, as well as the ramification to others who update or try to bisect a tree with a glibc change.12:43
jwesselI was wondering if the glibc do_compile rule could depend on the hash of the do_stash_local (), such that if it ever changes, we have to go all the way back to running do_compile, since that is where bin/localedef comes from?12:43
RPjwessel: isn't that like a normal task dependency?13:00
jwesselWell when the do_stash_locale () function gets changed, the do_compile and do_install never runs again for the glibc13:00
jwesselWhich causes the files that get mv'ed to be gone forever.13:01
jwesselAt least until the next time you cleansstate on the glibc.13:01
*** clement <clement!> has quit IRC13:01
RPjwessel: so some task isn't idempotent ?13:01
jwesselI believe so.13:02
RPjwessel: tasks are supposed to be so if its not, that is the real bug13:02
jwesselI am not entirely sure how the glibc bits were designed, but it is a problem with the way the sstate is "cheated".13:03
jwesselA number of folks in the community ended up seeing the problem building from the sstate, such that when the do_stash_locale runs (because it was changed by a patch I submitted), it runs the mv operation again, but there is nothing to move.  It is long gone.13:05
RPjwessel: just to be clear and check I understand, the real issue is that do_stash_locale() reruns but do_install doesn't, so files that were moved don't exist any more13:05
jwesselThe do_stash_local was setup to run before the sstate_save of the glibc.13:05
RPjwessel: do_stash_locale is the problem then, its meant to be able to be rerun and can't be13:05
jwesselSure.  To be clear, it wasn't a problem from my patch.13:06
jwesselThis is a long standing problem, I just wasn't sure how to fix it, but it seems like it should get fixed.13:06
RPjwessel: right, you just exposed the problem13:06
*** chandana73 <chandana73!~ckalluri@> has quit IRC13:06
jwesselThe obvious choice to me, at the time was to ask if there was a way to have this function be a part of the hash computation for the do_compile rule.13:07
mcfriskhave an image for which want to build SDK by default. Thus it has d.appendVarFlag("do_build", "depends", " {}:do_populate_sdk".format(pn)) and d.appendVarFlag("do_rm_work", "depends", " {}:do_populate_sdk".format(pn)). With latest master it also seems to need d.appendVarFlag("do_packagedata", "depends", " {}:do_populate_sdk".format(pn)). Is that expected or am I doing something silly?13:07
jwesselThe glibc has another separate problem in that bin/locale_def  only comes from the do_compile rule.13:07
RPjwessel: that doesn't fix the problem. The task just needs to be rewritten so it can be reexecute13:07
*** AndersD_ <AndersD_!> has quit IRC13:07
jwesselRP: That would imply you need a "double super secret stash", because there are no other copies of the files.13:08
RPjwessel: what happens if we just change the mv to cp and remove the rm ?13:08
jwesselI think who ever invented this, wanted to save some space or something.13:08
RPjwessel: perhaps, I think we need to unravel that problem though13:09
jwesselI don't understand why glibc-locale is a separate recipe in the first place.13:09
RPjwessel: going down the "more task hash magic" route won't help, trust me13:09
RPjwessel: that I do know, speed13:09
jwesselThat is why I thought I'd ask you first.13:09
RPjwessel: building and packaging locales takes an age and you want the rest of the build to continue13:09
RPjwessel: I'd guess a package preprocess func and a populate_sysroot preprocessing func which deleted the files they shouldn't see should have the same effect13:12
jwesselPerhaps I am look at it the wrong way then.  different question...13:13
jwesselWhy can't the stash function which does the mv stuff be in the do_install rule?13:13
jwesselThe bit that packages up the results shouldn't have to change.13:13
RPjwessel: do_stash_locale is an sstate task and do_install is not13:13
RPjwessel: I suspect that it will have to change13:14
jwesselTrying to simplify it in my mind...   The glibc (not locale) sstate depends on the do_install() implicitly already.13:16
RPjwessel: it comes down to a simple underlying principle in the buildsystem ignoring sstate13:16
RPjwessel: we allow arbitrary tasks to be re-executed13:17
RPjwessel: right now if you do "bitbake glibc -c stash_locales" and then rerun that, it breaks13:17
RPso sstate involved13:17
RPno sstate involved13:17
jwesselI hadn't tried that, but I would imagine that would break things.13:17
jwesselIn the same manner.13:18
RPso yes, sstate gets broken but that isn't the root problem13:18
jwesselI was thinking about it more from the perspective of the code changes.13:18
jwesselSo that day to day it builds.  The exec problem you just mentioned probably exists in a lot of places.13:19
RPjwessel: no, it doesn't or at least shouldn't13:19
RPjwessel: we did used to test for this but haven't for a while as its a long/painful test13:19
RPjwessel: if tasks can't rexecute, the whole system is just totally broken as we *rely* on that to be true13:20
jwesselThe tasks absolutely can re-execute so long as the bits they depend on re-run.13:20
RPjwessel: no, absolutely not13:21
jwesselFor example, if I ran by and the 3 temp files, it certainly still works.13:21
RPjwessel: tasks things depend on do not rerun untless they too have changed13:21
jwesselSo you understand why I asked the question how to make the do_compile() depend on the do_stash_locale.  :-)13:22
RPjwessel: I understand your question, yes but it means you don't understand how the system works13:22
RPand its not the correct fix13:22
jwesselI am not sure how to fix it, other than to use the cp vs the mv, and then glibc has all the extra files.13:24
jwesselPerhaps add to the glibc another package called glibc-locale-noinstall ?13:24
RPjwessel: That is basically the only way to fix it13:24
jwesselWhich collects the files?13:24
jwesselbut never gets installed by anything?13:24
RPjwessel: right, we change the mv/rm to cp and then have to fix the fallout "somehow", there are a few ways for that13:25
RPI'd rather not create it than create something we then have to "hide"13:25
RPjwessel: there are bascially two ways. One is cp instead of mv, the other is to mv into some special location and then check for the existence of that so you know not to redo parts of the operation13:27
RPjwessel: I prefer the cp approach and fix other fallout as I think it will be cleaner13:27
jwesselWell with a "cp" approach, some kind of glibc collector of the files needs to be added.13:28
jwesselElse we'll have "glibc created XXX files which are not packaged..."13:28
RPjwessel: or it removes the files13:28
RPjwessel: see PACKAGE_PREPROCESS_FUNCS += "gi_package_preprocess"13:29
RPand SYSROOT_PREPROCESS_FUNCS_append = " gi_ldsoconf_sysroot_preprocess"13:29
RPgi_ldsoconf_sysroot_preprocess ()13:29
RPjwessel: just the first examples I could come across but you get the idea13:30
jwesselI'll have a look.13:30
RPjwessel: they're operating on copies of the files so this is safe13:30
*** kaspter <kaspter!~Instantbi@> has quit IRC13:32
jwesselHow does one get at the copy that didn't get erased?13:33
*** kaspter <kaspter!~Instantbi@> has joined #yocto13:33
jwesselIt will still be in ${D}  ?13:34
jwesselIt is probably easy enough to try to see what happens...13:34
jwesselRP: Thanks for the insight.  I'll setup a test with the PACKAGE_PREPROCESS_FUNCS to purge the rm, and see where it goes.   If it works I'll submit a patch to fix it.13:41
RPjwessel: ${D} is the copy created by do_install13:45
*** AndersD <AndersD!> has joined #yocto13:55
*** AndersD_ <AndersD_!> has joined #yocto13:57
*** AndersD <AndersD!> has quit IRC14:00
*** berton_ <berton_!~berton@> has joined #yocto14:02
*** rob_w <rob_w!~bob@unaffiliated/rob-w/x-1112029> has quit IRC14:02
*** WillMiles <WillMiles!> has joined #yocto14:03
*** berton <berton!~berton@> has quit IRC14:05
blucaadding a new package to the SDK, dnf is failing as the last step when assembling it, with error "package foo does not have a compatible architecture"14:12
blucathe rpm content seems fine and not particularly different from other RPMs that are built14:12
blucaany tip?14:12
*** rcw <rcw!~rcw@> has joined #yocto14:14
blucathe binary inside the pkg seems to be fine14:15
blucaduh, it was a typo in the spelling of the pkgname in the local.conf -_- sorry for the noise14:18
*** lucaceresoli <lucaceresoli!> has joined #yocto14:23
*** AndersD_ <AndersD_!> has quit IRC14:26
tgoodwinHas anyone had trouble around thud with not all runtime dependencies being installed?  For example, I have a package that rdepends on python-numpy, however if I try to import it on the target, I get an error that future_builtins doesn't exist.14:42
Piratywhich is more common / correct? foo_<version>_any.ipk or foo_<version>_all.ipk for arch independent packages?14:48
rburtontgoodwin: sounds like the rdepends for numpy are not complete14:58
tgoodwinrburton: I'm chipping through it now; it caught me off guard since originally I had a slew of python packages in my image_install, which I pulled so that nothing "extra" was being required (save space, etc.) and then this broke.15:11
Croftontgoodwin, that is usually hiw we find bad DEPNDS :)15:15
*** TobSnyder <TobSnyder!> has quit IRC15:19
*** stephano <stephano!> has joined #yocto15:20
tgoodwinyep :)15:22
*** chandana73 <chandana73!~ckalluri@> has joined #yocto15:23
*** chandana73 <chandana73!~ckalluri@> has quit IRC15:24
*** chandana73 <chandana73!~ckalluri@> has joined #yocto15:25
CroftonALways a good test to build an image with only gnuradio and see if it does something useful15:25
tgoodwinI had to add python-modules to my image_install fix it (without extending my package's rdepends to include other ones).15:27
tgoodwin*to fix it... accidentally a "to"15:27
*** woutervh <woutervh!~woutervh@> has quit IRC15:28
*** Bunio_FH <Bunio_FH!> has quit IRC15:33
*** frsc <frsc!~frsc@2003:a:e7a:6200:246c:2a8b:f45a:a33d> has quit IRC15:38
*** tprrt <tprrt!~tprrt@> has quit IRC15:38
Croftontgoodwin, do need to track the root fix though and submit a patch15:43
*** mihai <mihai!~mihai@unaffiliated/mihai> has quit IRC15:55
*** yann <yann!~yann@> has quit IRC16:01
*** nerdboy <nerdboy!~sarnold@gentoo/developer/nerdboy> has joined #yocto16:03
*** yates <yates!> has quit IRC16:10
tgoodwinCrofton: indeed, but I'm not sure what the appropriate fix would be if this impacts any python module, for example.  As I was debugging this, it also impacted pydoc until I added python-modules to the image.16:12
tgoodwinThen everything was fine.16:12
*** kaspter <kaspter!~Instantbi@> has quit IRC16:16
*** kaspter <kaspter!~Instantbi@> has joined #yocto16:17
*** jmiehe <jmiehe!> has quit IRC16:20
*** stephano <stephano!> has quit IRC16:24
*** LocutusOfBorg <LocutusOfBorg!LocutusOfB@ubuntu/member/locutusofborg> has quit IRC16:25
*** vineela <vineela!~vtummala@> has joined #yocto16:31
*** saraf <saraf!~a_saraf@> has joined #yocto16:40
*** mckoan is now known as mckoan|away16:44
tgoodwinCrofton: no "fix" necessary maybe? says you have to install specific ones or "all" with python-modules, but it makes me wonder if it's a subset of the modules that makes this work correctly.16:50
*** florian <florian!~florian_k@Maemo/community/contributor/florian> has quit IRC16:56
Croftonis python-modules a meta-package that installs opthers?16:56
RPCrofton: yes, its all modules16:59
tgoodwinRP: is that "all modules" as in everything that can be built or "all" that the image has included?17:00
tgoodwin(I'm reading over that python function in python_2.7... right now)17:00
CroftonFor your afternoon enjoyment:
rburtonpython-modules (and python3-modules) is a meta-package that depends on all the modules17:10
Croftonso it sounds like numpy shoudl RDEPENDS on python-modules, or prefeably, the one it really needs?17:13
tgoodwinWell even when I manually added python-futures to my image, I couldn't import it from the python shell despite the egg, etc., being installed.17:14
tgoodwinIt's like there's something missing from the python package since I would think "import" should work if the package is installed.17:15
tgoodwinSo where I'm off the rails is figuring out which package it is that helps importing work (since it impacted pydoc too)17:16
*** rubdos <rubdos!~rubdos@2a02:578:859d:701:a846:9858:21a:9451> has quit IRC17:33
*** nmoos <nmoos!~moosnat@unaffiliated/moosnat> has joined #yocto17:35
*** rubdos <rubdos!~rubdos@2a02:578:859d:701:a846:9858:21a:9451> has joined #yocto17:36
*** saraf <saraf!~a_saraf@> has quit IRC17:42
*** awe00 <awe00!~awe00@unaffiliated/awe00> has quit IRC18:02
*** vineela <vineela!~vtummala@> has quit IRC18:02
*** behanw <behanw!uid110099@gateway/web/> has joined #yocto18:02
*** vineela <vineela!~vtummala@> has joined #yocto18:05
*** T_UNIX <T_UNIX!uid218288@gateway/web/> has quit IRC18:23
*** tgraydon <tgraydon!~tgraydon@> has joined #yocto18:29
*** chandana73 <chandana73!~ckalluri@> has quit IRC18:30
*** chandana73 <chandana73!~ckalluri@> has joined #yocto18:31
*** justanotherboy <justanotherboy!~justanoth@> has joined #yocto18:50
*** florian <florian!~florian_k@Maemo/community/contributor/florian> has joined #yocto19:08
jwesselThanks RP!   I'll send a patch out for review.  I was able to fix the do_stash_locale() implementation with your guidance.19:11
*** chandana73 <chandana73!~ckalluri@> has quit IRC19:14
*** chandana73 <chandana73!~ckalluri@> has joined #yocto19:14
*** bluca <bluca!~bluca@> has quit IRC19:18
*** awe00 <awe00!~awe00@unaffiliated/awe00> has joined #yocto19:28
*** wak-work <wak-work!wak-workma@gateway/shell/> has joined #yocto19:39
*** BCMM <BCMM!~BCMM@unaffiliated/bcmm> has quit IRC19:50
*** bluelightning <bluelightning!~paul@pdpc/supporter/professional/bluelightning> has joined #yocto20:01
*** justanotherboy <justanotherboy!~justanoth@> has quit IRC20:04
*** chandana73 <chandana73!~ckalluri@> has quit IRC20:16
*** chandana73 <chandana73!~ckalluri@> has joined #yocto20:17
*** BCMM <BCMM!~BCMM@unaffiliated/bcmm> has joined #yocto20:40
*** justanotherboy <justanotherboy!~justanoth@> has joined #yocto20:48
*** rcw <rcw!~rcw@> has quit IRC20:51
*** mort <mort!~mort96@snow/mort96> has quit IRC20:59
*** nerdboy <nerdboy!~sarnold@gentoo/developer/nerdboy> has quit IRC20:59
*** berton_ <berton_!~berton@> has quit IRC21:15
RPjwessel: thanks, at a quick glance it looks right. Appears we already had half a fix there for the cp vs mv :)21:19
jwesselIndeed it is true. Your assertion about the issue was spot on.21:20
*** WillMiles <WillMiles!> has quit IRC21:21
RPjwessel: Its good to have it fixed, I suspect there are others like it. We have a script somewhere which basically runs bitbake X -c Y -f to test for issues like this21:23
RPjwessel: its a lot of combinations though21:24
jwesselI am not even sure that would have uncovered it though in this case.21:24
jwesselIt isn't until you try to build glibc-locale after running it a second time, that it chokes, because it had catches for the existence of the files.21:24
RPjwessel: I guess you'd need "bitbake glibc -c stash_locales -f; bitbake glibc-locales" :/21:25
RPjwessel: that is indeed harder :(21:25
jwesselFinding that is a bit more by accident.  That is why I wanted to get it fixed for the next guy that comes along.21:26
jwesselPlus, I didn't want things to break when I push the next set of patches to our end user base.21:26
jwesselI never want a situation where an incremental build fails for some odd ball like this.21:26
jwesselPlus the error generated non-sense, not pointing you to any obvious root cause. :-)21:27
*** Saur <Saur!> has joined #yocto21:31
*** Saur <Saur!> has left #yocto21:31
*** stephano <stephano!> has joined #yocto21:33
RPjwessel: totally agreed on fixing it. I'm just trying to think about better detection21:37
RPI guess force running and sstate hash equivalence testing would be the test here21:37
RPsstate content comparison for hash equivalence to be clear21:38
jwesselDetection is interesting.  If you wanted to per package check it, that would have been caught.21:41
jwessele.g. Build package glibc21:42
jwesselRun a subtask again and let it go all the way through packaging and check sstate.21:42
jwesselIt would definitely have been different the second time because there was nothing left to move.21:42
jwesselI am guessing that would probably catch most of these that don't just blow up when you run it a second time.21:44
RPjwessel: I guess buildhistory would detect this. The question is how much of a build to rerun21:45
jwesselI doubt you want to check a whole build the whole way through as it gets expensive, but per package seems reasonable.21:47
jwesselMy question is how many packages have the sub tasks that need checking?21:47
RPjwessel: well, in theory you can break any task so it doesn't rexecute without some side effect21:47
RPjwessel: This isn't something anyone likely has time to look at right now, its just interesting to remember what may have helped or worked better21:48
*** khem <khem!~khem@unaffiliated/khem> has joined #yocto21:48
*** stephano <stephano!> has quit IRC22:07
__angelofirst steps into custom distro, i am getting "FileNotFoundError: [Errno 2] file conf/bitbake.conf not found"22:26
*** florian <florian!~florian_k@Maemo/community/contributor/florian> has quit IRC22:44
*** agust <agust!> has quit IRC22:54
*** erbo <erbo!> has quit IRC23:17
*** gnac <gnac!> has quit IRC23:22
*** gnac <gnac!> has joined #yocto23:22
*** BCMM <BCMM!~BCMM@unaffiliated/bcmm> has quit IRC23:36
*** JaMa <JaMa!> has quit IRC23:42

Generated by 2.11.0 by Marius Gedminas - find it at!