Artifact e8c374f670bebb46b6c176ffc410cb9e5e7961ad

Manifest of check-in [e8c374f670] - Importer Status...

Speed. This is now mostly acceptable. The one exception is pass 'BreakAllCsetCycles'. The reason is that the limit computation it does for backward branches still uses the inefficient file-level dependency computation. This will be tackled in short order. For the other passes the file spent is 'CsetsDeps' is recouped by the much faster graph setup.

Memory. This seems to be mostly acceptable as well, with the exceptions of 'BreakAllCsetCycles' (again, for reasons see above), and 'InitCsets'. It seems to happen while the pass breaks internal dependencies, but there is no hard data. I have to measure using a memory-debug enabled tclsh. I suspect either the actual internal dependencies, or the pseudo-dependencies. Maybe combined with a bad choice of data structures. Well, measuring first.

by aku on 2007-12-02 20:06:13.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

C Importer\sStatus...\n\nSpeed.\sThis\sis\snow\smostly\sacceptable.\sThe\sone\sexception\sis\spass\n'BreakAllCsetCycles'.\sThe\sreason\sis\sthat\sthe\slimit\scomputation\sit\sdoes\nfor\sbackward\sbranches\sstill\suses\sthe\sinefficient\sfile-level\sdependency\ncomputation.\sThis\swill\sbe\stackled\sin\sshort\sorder.\sFor\sthe\sother\spasses\nthe\sfile\sspent\sis\s'CsetsDeps'\sis\srecouped\sby\sthe\smuch\sfaster\sgraph\nsetup.\n\nMemory.\sThis\sseems\sto\sbe\smostly\sacceptable\sas\swell,\swith\sthe\nexceptions\sof\s'BreakAllCsetCycles'\s(again,\sfor\sreasons\ssee\sabove),\sand\n'InitCsets'.\sIt\sseems\sto\shappen\swhile\sthe\spass\sbreaks\sinternal\ndependencies,\sbut\sthere\sis\sno\shard\sdata.\sI\shave\sto\smeasure\susing\sa\nmemory-debug\senabled\stclsh.\sI\ssuspect\seither\sthe\sactual\sinternal\ndependencies,\sor\sthe\spseudo-dependencies.\sMaybe\scombined\swith\sa\sbad\nchoice\sof\sdata\sstructures.\sWell,\smeasuring\sfirst.
D 2007-12-02T20:06:13
F BUILD.txt e7fed9d5b647337f8e7abf45981d10cdcc1555e2
F COPYRIGHT-GPL2.txt 06877624ea5c77efe3b7e39b0f909eda6e25a4ec
F Makefile 80acf0670d85f6d42cfc7459f462ac0a24b16c80
F art/CollRev1.dia 186c7bb7a88c533ab226431bbd7c4835bb6ac2a0
F art/CollRev2.dia 59b1c331a52e19f44f2dcf7c744dd5aaabd2b5cf
F art/CollRev3.dia d14a7b35e0af533998e705e771b504f8aaaead96
F art/CollRev4.dia be6e84c213b52cad03e3192fe8ba941709564fd4
F art/concept1.dia 84f4b61b5f22eb62752c4aa04a955d424f9d2a00
F art/concept2.dia 45f46122096e5d29536c7670ec214e9ac478ef43
F art/delta1.dia 1e1461fa6f5d7e5a3d9207d0da8091e85ea3c62d
F art/delta2.dia 5e2acf9cd1e5c75b7f08eac61602b224626a8939
F art/delta3.dia 822f600d80faca38daa35ba10ddee2ef89ee97bf
F art/delta4.dia 7184224cface58098e74c518e1aeb155645fb915
F art/delta5.dia 42c52e3c7c6b853b3eca596b183fa43d75fd841d
F art/delta6.dia 638abaa6b4ca7c348d1a00d96f5d6676231e6e37
F art/encode1.tex bb4fa24df875f09c104ac535727a885ecd1b0126
F art/encode10.dia 5957690e4d2e7e75412247830267678e95634552
F art/encode2.tex 0a86eb21bb6fd8ccec597e6651d5d038aaf07baf
F art/encode3.tex e14430ac5a65400a5c2c4f0fef0274bfe94c69ea
F art/encode4.tex ef19f3297df533c6baa0500dbcda54de333b8830
F art/encode5.tex 8c67f6dc7e52de7d4f46b140627e14466a73a180
F art/encode6.tex 460b9901beab1ec022abe860fc4b494652dad206
F art/encode7.tex 52fdbf5294043369dde8c7859168454d130d449a
F art/encode8.tex 002741146eee8ee5b8a99ddd27246e2b926fbf32
F art/encode9.tex 84df5abf42b007748ec0ea1e3bd4ad2628502335
F ci_cvs.txt 78baac691103d2b30c4ca98bdd531d3ecd52bf6c
F ci_fossil.txt 2064b7fe7f2f347b5b56603d4fdcb06979cf6736
F ideas.txt 44635deb96c9ba324a8b472924c49b76b3e1fcc1
F src/VERSION 24bbb3aad63325ff33c56d777007d7cd63dc19ea
F src/add.c 771768ca0df7c60d60b2e88140d0a1c8d2c76fbf
F src/bag.c c1c41296e0eaea11f16f1490d5a46be138e6baf5
F src/blob.c f2c016552c1006e1ead1f64366a650471e0e4064
F src/cgi.c f25a72aeb6ba2d5d8eb1886de143c32d389244ff
F src/checkin.c 08fa2df4cf4b605db36faa8e6adc87d3717a1a4d
F src/checkout.c 226cbdc63b6141aa2034b1a2eec72df93ee6fa00
F src/clearsign.c b83f245b62403c327b76020cadae9206a5b98623
F src/clone.c 9c95e6e8e67cc7ac7968dcb16b3c5c57c14702df
F src/comformat.c 26c0414fd89346d1d1cfda0762fd8fddbca144b1
F src/config.h b4a2d638880a5ed7a1908c9ad2d4cb99ec758c00
F src/construct.c 10bb790dafbf85fb41571d9cab31a16c2026da94
F src/content.c 310f7c7a1fcc286122bbf7df225db81d1682bac6
F src/db.c 7ab2af8add0d0220c923bc506be2396424a28f2d
F src/delta.c e79479fc0f1bd3543cc6772955beb2c2c4714120
F src/deltacmd.c e730b77c18f05c0c72e8c5d9825a31eae58a0fc2
F src/descendents.c fc1b9b6b12455726a754a420e8a06c8e95b91323
F src/diff.c 43924b37217e5d2e902869d9bef0a95ea6b143a5
F src/diffcmd.c 16a1f7054397ddb7f075514b927f3e4fbc7a3be5
F src/encode.c 6c31150f725f911658fbc10192a8a7e39bfad10c
F src/file.c 43aa6bdf650be1e986e24eb5ac04f42a1d8d3cb7
F src/http.c 43986095c41b6de6095f6067a10a97cc5b9a09b3
F src/info.c 1d02bccab4f60d6f2f926c8cefd3420359f01901
F src/login.c 4e89d2580b81c4f0b42fefe243c410b10240b75d
F src/main.c 17322e8c2b317c1b328757ebda8ad020366baa4a
F src/main.mk 0a509459607c19e704eaaa235dde94972857711a
F src/makeheaders.c b7bbc46f28d9e4396b772a389103158e1eff05d3
F src/makeheaders.html 0e4ade7e463ae2bf1595d615a949d2cc14a2a5b4
F src/makemake.tcl 7db41ee41dc37b4eec3bd29823582629d11de795
F src/manifest.c 3b8a4242be7e04db315808edf032bbaa004f4b00
F src/md5.c 15acdef8fff01aefa815ceaa392ea59185d47f3d
F src/merge.c 246b01382f1423be023aff0845007ea514eb846e
F src/merge3.c 5d18e08162e0656a84213840d2d938a5c6fb3690
F src/mkindex.c 634272abcb7d96b8e82c2e91da6b18953c587d15
F src/name.c c08d5131363b500cd7d2f34f28be387b01076f85
F src/pivot.c 2953f62a20e8f8584f272b125b6ee4f1e28a9d90
F src/pqueue.c c849b6ba261f655c2a5840e14d0be53df1a523da
F src/printf.c 48f1118d8ef597aefabf09ff489f7b3bfa462ffa
F src/rebuild.c 45c4994360d49e70cdb7767c2a37cb0277dee72c
F src/schema.c 23e27b4093eec0b91367d4db75e8e97d469fac95
F src/setup.c 0c2a6e74d50d0a2f1548f6bb70db4b90b95a3672
F src/sha1.c 2a394ff16cb67dad1e87190be62bc7ccfc244ed9
F src/sqlite3.c 78b516735165072e986247f4667a84a5870fd889
F src/sqlite3.h 535f235f65b21ca83ff426b755a49e4ca3624dee
F src/style.c 4e8cafc457e75f0630b6b672a2989e5956a87374
F src/sync.c fc0e1584ee16739bd0601104e5e3a4c6a1e29642
F src/timeline.c 44b77956607345d6301a2febcaeaf28debad78e7
F src/translate.c 40ee3ab1003fceddf0e90115c8bb28e040da4550
F src/undo.c e0974f54288126b0fa22998103a0c5f175a93c4e
F src/update.c 6cc6e53fd7e4a07c6c3e28335b9553e4df7ae69b
F src/url.c 6f5bc8946f0938031d783abd1d0f53e2891e0490
F src/user.c 7f6b214713c458a4bfc9c2bdffb36b100ff96def
F src/verify.c a3038ce20f3906ca1dbcb516fc0c389c19b218fd
F src/vfile.c 5ad913c384f94b6fa54b89ec9a7aeb1e1f600144
F src/wiki.c 804763a66e138a63988dc8f659c517d40cd7ef20
F src/wikiformat.c a4e0918f2378286f902317c65fe778e6e03be2a8
F src/xfer.c 1a89a70762f7321928e500ce489ecdafe50e74ba
F src/zip.c a6ead783d298ac49f3edfeb9e0d41d64cdcf40ed
F test/delta1.test 08d7071c425e560715a6c8d2916369ec5679fa2e
F test/merge1.test 419c5c1aa7f65358008dca1190900e2f90f48950
F test/merge2.test 9b6f797f40414450c29bca52e89a328a586fef40
F test/tester.tcl 8cd24c134d1f6a87a9d5d0493d6b44be4b66be4b
F todo-ak.txt 7f4b3bcffb2e80a3ff0741198e6a08d1b513ffc0
F todo.txt 55905ed361b156c0a8fb71b32eb99213ee74434e
F tools/cvs2fossil/changeset 60a9ddc157ed086dbc7a06ef3b3c188148814be0
F tools/cvs2fossil/cvs2fossil df73a69477f7abbe7d25d905d4604d01b567ef26
F tools/cvs2fossil/doc/LICENSE aede671429a0e8a5cc2fa35dfe5bcadd5c281b58
F tools/cvs2fossil/doc/README 6d655c3f823db2a177d32af6d904ca0426a74e9b
F tools/cvs2fossil/filerevtree b6e112463408bbcf51287f58dd997e256f3cd390
F tools/cvs2fossil/lib/c2f_cyclebreaker.tcl 775fd1f9e50b00e78a90fa8b6dff8b58f288294e
F tools/cvs2fossil/lib/c2f_file.tcl 995eee5b4cfa45df61352be1c23043921d91b896
F tools/cvs2fossil/lib/c2f_flodmgr.tcl 36700e34ad9e3f222efcd08dc5fc670df8d132ab
F tools/cvs2fossil/lib/c2f_frev.tcl 72b07e1bd51da1c7273808716c20a00e09c3a8c4
F tools/cvs2fossil/lib/c2f_fsym.tcl 6b46b59edbfa02370976c02e8e128db8eebdb3ae
F tools/cvs2fossil/lib/c2f_ftrunk.tcl 116792654a5a7ee6745262756b7cd9a028482eb6
F tools/cvs2fossil/lib/c2f_integrity.tcl 3028615e2ae6c9863414c1464e0fb15a2ece6a96
F tools/cvs2fossil/lib/c2f_option.tcl 5835c5aa1e8e3b3b0524c0069001a755a7b294a3
F tools/cvs2fossil/lib/c2f_pass.tcl b27a6e1d116415dc5ca7d92637f4729089ca5c32
F tools/cvs2fossil/lib/c2f_patopsort.tcl bd713af4f16bcf0ba5deb402563768beaa2101ef
F tools/cvs2fossil/lib/c2f_pbreakacycle.tcl 9244bb5c27f6171d72a851e29677eb5512353359
F tools/cvs2fossil/lib/c2f_pbreakrcycle.tcl 3c073e957a33edde844003a8e018bbf946820cb2
F tools/cvs2fossil/lib/c2f_pbreakscycle.tcl 24924cb693d1755631ecf99c7c559ea8ee21ef1f
F tools/cvs2fossil/lib/c2f_pcollar.tcl a368b702c329d622929f35b637cacd10af57f4a1
F tools/cvs2fossil/lib/c2f_pcollrev.tcl e100446c46d797aeaee0a541bb2078b2d5176cd8
F tools/cvs2fossil/lib/c2f_pcollsym.tcl 47871c6aa239d6e4e80064d73a63780e5fb240d0
F tools/cvs2fossil/lib/c2f_pfiltersym.tcl 940562fb7e45bcc0c57a61bffb0df9bade952ecd
F tools/cvs2fossil/lib/c2f_pinitcsets.tcl ced4d957b164bc3d628e7d7765aea4c1dfe6e338
F tools/cvs2fossil/lib/c2f_plodmgr.tcl 12b4220042da8084b8902b4b4603b71fcb36e9f5
F tools/cvs2fossil/lib/c2f_prev.tcl bf483d028a0f07379f4eb34cc68a40d3e395f607
F tools/cvs2fossil/lib/c2f_prevlink.tcl 3ad12043d17dfda16a9a836c543dbf6a918b739f
F tools/cvs2fossil/lib/c2f_project.tcl 2573fce4030b56489527b3ba261e9149fdef5e17
F tools/cvs2fossil/lib/c2f_prtopsort.tcl 108eb140ec4f858b5d12d616419e7f3d106e45a5
F tools/cvs2fossil/lib/c2f_psym.tcl 46632d18742da9acbf167ec1163f5055b3c54249
F tools/cvs2fossil/lib/c2f_ptrunk.tcl b801a7da3aa8da90b8af810554353e74a70ab155
F tools/cvs2fossil/lib/c2f_repository.tcl 6b33138cb4b327fe004cdc2193b0ceb2716f9afc
F tools/cvs2fossil/lib/c2f_state.tcl e4b4a90ad76089fd89c6b64d49ea5fa423b02a7f
F tools/cvs2fossil/lib/cvs2fossil.tcl fb15e077e1d7048710b1d0a26c540bdf2aa6c4d9
F tools/cvs2fossil/lib/dot.tcl d011b07faecc7d1f73bd7e2ad424aec40f12aa36
F tools/cvs2fossil/lib/id.tcl ad0171bebe08b12ce2197e444b1237e9dfabf68a
F tools/cvs2fossil/lib/log.tcl 875fe25bc72ca017813d7a62fa65a6fbe23e44db
F tools/cvs2fossil/lib/misc.tcl 98d22d51095be285caadea050ee08bb6664153f7
F tools/cvs2fossil/lib/pkgIndex.tcl bba80efcbb5a57725cbc350c9790e4073cb76859
F tools/cvs2fossil/lib/rcsparser.tcl e6259bae92fc248b523c3a45c3c600b83192a9a9
F tools/cvs2fossil/lib/trouble.tcl c6cef7555cede649dab283c4a15ea0d2ec71d042
F tools/cvs2fossil/lodtree eadeb78341c0c59f1dec0f0db0383bf797f5ca8f
F tools/cvs2fossil/showg 3b5479d1527a33cf1316fcab935a127d86cf3532
F tools/cvs2fossil/symboltree 6c405827269eda1089a1ffe58e03b4657a7bdfa6
F tools/encode_math.sh 86eb1215d85a3e796788b6a4c2354b3f096f5f88
F wiki_and_ticket_ideas.txt 210e4ddb28eb077b7262ac8c2cdb5d2391410f1e
F www/CollRev1.gif 3ca46d72571bc56d114d467ec8d291541c9ae932
F www/CollRev2.gif 581afba0a01d5fd62e06ebbed88e76e51a5d1d6c
F www/CollRev3.gif 996e26f2d6182a95e4e0781529cd34178e3bfa25
F www/CollRev4.gif 2344026a4ce78a39b198ccbd3accd554798aa915
F www/build.html ea6b1e4bf31262805e83791ac0b19d611b39161d
F www/concept1.gif 6bb98f69a2cfe883ad6dbfbb70561b2282a563e1
F www/concept2.gif ff6165d1e94186362309c951622c8dcee6edcf2c
F www/concepts.html d53cc73d6e92ab43f53ddd878e2267d6480af076
F www/delta1.gif fc676aedbef6ec9670dca75fd815371f6fbd7143
F www/delta2.gif 305bcc078165737af0fc8001c37b42fca568fa72
F www/delta3.gif ecdccfa728b9e060d8d9541b7851818e4ff435a2
F www/delta4.gif 235b08d75ca98d34ba8b5bcaf38aeaf975ec51b4
F www/delta5.gif 990001794fe052e5163bc5423ad0968fdc9ced92
F www/delta6.gif 325bffc28f96aa9a73696e260cba68a1668ac31a
F www/delta_encoder_algorithm.html 2fdda5715167189835f74038508c3cccddcd1c4d
F www/delta_format.html db8d44b23e31e469b4fc2ff718eecf858b838182
F www/encode1.gif d75ce317b5f940c6f557cf76540de2aa1cde8c0b
F www/encode10.gif 36b56c4055dc85e63cf28d7b07e0004b20e2a7bf
F www/encode2.gif e2b657c112227549b9424508cc0753bf2f82b03e
F www/encode3.gif 1565ebf8d7579785bc05ce80434b2eae1773a813
F www/encode4.gif 7879afadc59db61606e70f88ad387587ccb6242d
F www/encode5.gif 90a35e3626b0196878c728954fc832a3c7d58f2a
F www/encode6.gif ca683ebcfa2a32946c9d7f613ab1ceb50cb450ff
F www/encode7.gif 5bb9e59f86d8dc85bb08398441081864b73405f9
F www/encode8.gif 99cb8d91c37c30f7ebe05506980579263e017315
F www/encode9.gif 7aca8807ddf4eff0b01745b0dc3012cea104a817
F www/fileformat.html 65db56924de1ac3c632126100c6a5dbccdaa2845
F www/index.html c49cf389d31138dedb23a39910aaa049667e664e
F www/index.wiki 314475c431784269892809f8882996d9c80fa185
F www/pop.html be259767d3cdade46dc5e77584af5d9f4e3dc7c9
F www/quickstart.html 427965635d9c24b6a330b14cec2cf5566f464f8a
F www/selfcheck.html 48d946181712dc8f97cff5b6a039d06755a75258
F www/sync.html 4b7a0c18217f58fb6793f31988683bbd915c5d3f
P 00bf8c198ee6db85e9ec3868df1b6649695ae0e3
R 84543c0f3dbf65340a1256eb15de3277
U aku
Z b0759352903b812d66a0676105598b00
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.3 (GNU/Linux)

iD8DBQFHUxA1vonzZ/CRa7gRAtuQAJ0ftQddITxWmAtV+T/8FGzF+zbVzgCeJvZm
5tV6BoaXmvpSoAmep2r4mwY=
=z76X
-----END PGP SIGNATURE-----