tag:blogger.com,1999:blog-32054652.post788486431772356222..comments2024-03-29T00:16:17.886-07:00Comments on Thoughts about computer technologies: Tdpkg 1.0 - speed up reading dpkg databaseLuca Brunohttp://www.blogger.com/profile/06329046616630750783noreply@blogger.comBlogger28125tag:blogger.com,1999:blog-32054652.post-62098796526982734422021-10-24T22:41:04.721-07:002021-10-24T22:41:04.721-07:00Thanks for providing this information. It's ve...Thanks for providing this information. It's very helpful.<br /><br />ABHIRAM ASTROLOGY CENTER.<a href="https://indianastrologycentre.com/best-astrologer-in-edmonton/" rel="nofollow">Best Astrologer In edmonton</a><br /><br />abhiramindiahttps://www.blogger.com/profile/05941904663062216548noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-92032476699078445862021-10-22T02:17:28.153-07:002021-10-22T02:17:28.153-07:00Thank you for the great post!
DURGAANUGARHA ASTRO...Thank you for the great post!<br /><br />DURGAANUGARHA ASTROLOGY.<a href="https://durgaastrologer.com/best-astrologer-in-belgaum/" rel="nofollow">Best Astrologer In belgaum</a><br /><br />DurgaAnugarhahttps://www.blogger.com/profile/17426225999792017627noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-67628647177392661312021-09-20T00:39:07.956-07:002021-09-20T00:39:07.956-07:00Nice post!
SRI ANNAPOORNESHAWARI ASTROLOGY CENTER....Nice post!<br />SRI ANNAPOORNESHAWARI ASTROLOGY CENTER.<a href="https://famousastrocentrebangalore.com/best-astrologer-in-%20Indiana/" rel="nofollow">Best Astrologer In Indiana</a><br /><br />pandith13https://www.blogger.com/profile/00439278007687740853noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-56780896089769946642012-01-03T22:31:08.432-08:002012-01-03T22:31:08.432-08:00I enjoyed reading your articles. This is truly a g...I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!purchase domain namehttp://www.register-domainname.innoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-29105704382673653892010-10-26T12:57:12.738-07:002010-10-26T12:57:12.738-07:00Tdpkg is not more compatible with current dpkg, wh...Tdpkg is not more compatible with current dpkg, which gained some speed finally. So you must not use it anymore. Though making it compatible again would be faster than dpkg, it's not worth it anymore like before.Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-58870410381216279562010-10-26T05:44:13.218-07:002010-10-26T05:44:13.218-07:00Well, I just tried both flavours (sqlite and tokyo...Well, I just tried both flavours (sqlite and tokyo) without much luck. It seems to manage to cache all 3894 .list files in the info dir but then starts spitting loads - and I mean loads - of error messages:<br /><br />tdpkg: nested open(/var/lib/dpkg/info/libxcb-keysyms1.list, 0, 38) detected, no wrapping<br />tdpkg: nested __fxstat64(10) detected, no wrapping<br />tdpkg: nested read(10) detected, no wrapping<br />tdpkg: close() on unknown fd 10, no wrapping<br />tdpkg: nested open(/var/lib/dpkg/info/libxcb-event1-dev.list, 0, 29) detected, no wrapping<br />tdpkg: nested __fxstat64(10) detected, no wrapping<br />tdpkg: nested read(10) detected, no wrapping<br />tdpkg: close() on unknown fd 10, no wrapping<br />tdpkg: nested open(/var/lib/dpkg/info/wireshark-common.list, 0, 25) detected, no wrapping<br />tdpkg: nested __fxstat64(10) detected, no wrapping<br />tdpkg: nested read(10) detected, no wrapping<br />tdpkg: close() on unknown fd 10, no wrapping<br />tdpkg: nested open(/var/lib/dpkg/info/libunac1.list, 0, 34) detected, no wrapping<br />tdpkg: nested __fxstat64(10) detected, no wrapping<br />tdpkg: nested read(10) detected, no wrapping<br />tdpkg: close() on unknown fd 10, no wrapping<br />...<br />...<br />etc.<br /><br />Instead of being faster it ends up being much slower...Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-67793094842574324802010-05-27T00:59:15.160-07:002010-05-27T00:59:15.160-07:00Thanks for testing Mishoo. There's was a bug i...Thanks for testing Mishoo. There's was a bug in Ubuntu too. Also consider new dpkg versions will finally speed up as well, up to 3 seconds on my pc without cache.Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-70854432323339795182010-05-26T23:34:34.985-07:002010-05-26T23:34:34.985-07:00Just managed to make it work with Ubuntu 9.10. Wh...Just managed to make it work with Ubuntu 9.10. What I did:<br /><br />1. I put the aliases in /etc/bash.bashrc (for dpkg, apt-get and aptitude)<br /><br />2. I needed to run some dpkg command as root to create the DB, but sudo *doesn't* work for some reason (perhaps it doesn't expand aliases). So just login as root.<br /><br />3. To test, I did a sync and then echo 3 > /proc/sys/vm/drop_caches (just echo 1 didn't clear enough cache data, and I first thought it kicks in, but it was still using plain dpkg and with cache).<br /><br />FYI I have over 11000 files in /var/lib/dpkg/info and the "Reading database" operation was painfully slow (took like one minute) although my hardware is more than decent (Core 2 Duo @ 2.8GHz, 4GB RAM, 7200 rpm hard drive).<br /><br />Thanks for this great little tool that the DPKG maintainers should have done for years!Mishoohttp://mihai.bazon.net/blognoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-22193464293135930892010-05-26T23:20:16.863-07:002010-05-26T23:20:16.863-07:00It's a shame that the maintainers didn't c...It's a shame that the maintainers didn't consider your idea for so long. This bug was first reported in 2000 [1] and it's still there. Just awful.<br /><br />[1] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=69192Mishoohttp://mihai.bazon.net/blognoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-80974584575820092662010-03-23T23:12:53.307-07:002010-03-23T23:12:53.307-07:00porc.. è una scheggia!! prima ci metteva 24-25 sec...porc.. è una scheggia!! prima ci metteva 24-25 secondi a caricare il database ora il processo è diventato istantaneo!! meraviglioso!è strano che ancora non l'abbiano introdotto ufficialmente nelle varie ditro debian-based<br />ottimo lavoro:-)red_magehttps://www.blogger.com/profile/09270951346063672247noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-33377723701889283972010-03-17T12:53:16.814-07:002010-03-17T12:53:16.814-07:00Yes you should ensure root use those aliases too.Yes you should ensure root use those aliases too.Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-40755469992557810522010-03-17T07:11:19.792-07:002010-03-17T07:11:19.792-07:00Could it depend on sudo?
Does sudo use the user al...Could it depend on sudo?<br />Does sudo use the user alias?<br />Or should we put the alias in the root's .bashrc and invoke aptitude as root?<br /><br />Just an idea.<br /><br />CiaoAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-35920750580597326102010-03-17T02:14:19.902-07:002010-03-17T02:14:19.902-07:00Good job! It works well and speeds things up drama...Good job! It works well and speeds things up dramatically.<br /><br />jackAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-64891116852824363332010-03-17T01:54:39.397-07:002010-03-17T01:54:39.397-07:00I don't know Andrew, I'm able to use it as...I don't know Andrew, I'm able to use it as well as I use aptitude. I'm using zsh pheraphs apt-get can be incompatible with alias?Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-76779229823097785302010-03-16T15:03:28.209-07:002010-03-16T15:03:28.209-07:00Thanks for answering so fast. Hmmm I can't see...Thanks for answering so fast. Hmmm I can't seem to get apt-get to work.<br /><br />Like so: alias apt-get='LD_PRELOAD=/root/tdpkg/libtdpkg.so /usr/bin/apt-get'<br /><br />?<br /><br />It doesn't seem to pick up tdpkg...Andrewhttp://www.webupd8.orgnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-13320978056237178202010-03-16T14:53:44.529-07:002010-03-16T14:53:44.529-07:00Nice Andrew. You have to alias also aptitude and a...Nice Andrew. You have to alias also aptitude and apt-get, because they call dpkg bypassing the shell, so alias won't work. Thanks for bumping the news :)Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-72094587200780957082010-03-16T14:36:27.848-07:002010-03-16T14:36:27.848-07:00OK, I got it working by placing the alias in the /...OK, I got it working by placing the alias in the /etc/bash.bashrc file instead of ~/.bashrc<br /><br />Not tdpkg is triggered when running "dpkg -i *.deb" but I don't see anything related to it when running "apt-get install". Does this mean it only works for "dpkg -i ..." or must I do something else to get it working with apt-get?<br /><br />Sorry for bothering you so much... I just wanted to present your tool to my blog's readers (and also use it myself, obviously) and I'm trying to make sure I have all the facts right.Andrewhttp://www.webupd8.orgnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-55691805685922291162010-03-16T14:20:45.364-07:002010-03-16T14:20:45.364-07:00@Luca: Like I said, the alias shows up when runnin...@Luca: Like I said, the alias shows up when running the command "alias" in a terminal but it just doesn't use it when running the actual dpkg.<br /><br />I've used it like this:<br />alias dpkg='LD_PRELOAD=/home/andrei/tdpkg/libtdpkg.so /usr/bin/dpkg'<br /><br />but also like this:<br />alias dpkg="LD_PRELOAD=/home/andrei/libtdpkg.so /usr/bin/dpkg"Andrewhttp://www.webupd8.orgnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-42184573368723730512010-03-16T14:14:06.001-07:002010-03-16T14:14:06.001-07:00@david you need to be root at least for the first ...@david you need to be root at least for the first time in order to create the cache<br /><br />@Andrew could you post the alias you're using? Don't use quotes in LD_PRELOAD when using the alias<br /><br />I've deleted the message of Anonymous for privacy (explicitely requested by him).Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-81499111914933804842010-03-16T14:06:09.365-07:002010-03-16T14:06:09.365-07:00actually there's a message.
I think it is some...actually there's a message.<br />I think it is something related to permissions of the cache file:<br />(861)-~% dpkg -S cdsvbfcsdfgbvcds<br />tdpkg tokio: no permission<br />tdpkg tokio: no permission<br />tdpkg: file /var/lib/dpkg/info/libexempi3.list not up-to-date in cache, rebuild cache<br />tdpkg tokio: no permission<br />tdpkg tokio: no permission<br />tdpkg: can't rebuild cache, no wrapping<br />tdpkg tokio: no permission<br /><br /><br />and if you need:<br />ls -alh /var/lib/dpkg/info/tdpkg.cache<br />-rw-r--r-- 1 root root 12M 2010-03-16 08:20 /var/lib/dpkg/info/tdpkg.cachedavidnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-90834436485130526932010-03-16T14:06:09.366-07:002010-03-16T14:06:09.366-07:00I found out why it wasn't working for me: the ...I found out why it wasn't working for me: the alias doesn't work but running directly the command with LD_Preload works. The alias is listed when running "alias" but it just doesn't process it when running apt-get or dpkg for some reason. Any ideas regarding this.Andrewhttp://www.webupd8.orgnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-24312643781062047032010-03-16T13:29:34.156-07:002010-03-16T13:29:34.156-07:00Output looks ok. Do you get any message starting w...Output looks ok. Do you get any message starting with tdpkg:... when you run LD_PRELOAD=./libtdpkg.so dpkg -S test ?Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-11619700188514410132010-03-16T13:14:47.561-07:002010-03-16T13:14:47.561-07:00objdump -T /usr/bin/dpkg|grep open
00000000 D...objdump -T /usr/bin/dpkg|grep open<br />00000000 DF *UND* 00000000 GLIBC_2.0 open<br />00000000 DF *UND* 00000000 GLIBC_2.1 fopen64<br />00000000 DF *UND* 00000000 GLIBC_2.1 fdopen<br />00000000 DF *UND* 00000000 GLIBC_2.0 opendir<br />00000000 DF *UND* 00000000 GLIBC_2.1 fopen<br />00000000 DF *UND* 00000000 GLIBC_2.2 open64<br /><br /><br />objdump -T /usr/bin/dpkg|grep stat<br /><br /><br />00000000 DF *UND* 00000000 GLIBC_2.1 statfs64<br />00000000 DF *UND* 00000000 GLIBC_2.0 __xstat<br />00000000 DF *UND* 00000000 GLIBC_2.2 __xstat64<br />00000000 DF *UND* 00000000 GLIBC_2.2 __lxstat64<br />00000000 DF *UND* 00000000 GLIBC_2.2 __fxstat64Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32054652.post-52411568038048102582010-03-16T13:02:49.682-07:002010-03-16T13:02:49.682-07:00It's 100% full compatible with tdpkg, then dpk...It's 100% full compatible with tdpkg, then dpkg, then apt and all variants. It only acts as a cache when possible. When you use dpkg then tdpkg again, the cache is rebuilt for consinstency.<br /><br />For ubuntu it can be different, because debian uses eglibc. You can help me by doing objdump -T /usr/bin/dpkg|grep open and objdump -T /usr/bin/dpkg|grep stat<br /><br />Thanks.Luca Brunohttps://www.blogger.com/profile/06329046616630750783noreply@blogger.comtag:blogger.com,1999:blog-32054652.post-84881706164323281842010-03-16T10:35:37.714-07:002010-03-16T10:35:37.714-07:00Thanks I really was waitin for (or thinking to imp...Thanks I really was waitin for (or thinking to implement) something like that since long time!Treviñohttps://www.blogger.com/profile/07275912239018307847noreply@blogger.com