Fossil: Check-in [00bf8c198e]

Overview

SHA1 Hash: 00bf8c198ee6db85e9ec3868df1b6649695ae0e3

Date: 2007-12-02 20:04:40

User: aku

Comment: The performance was still not satisfying, even with faster recomputing of successors. Doing it multiple times (Building the graph in each breaker and sort passes) eats time. Caching in memory blows the memory. Chosen solution: Cache this information in the database.
Created a new pass 'CsetDeps' which is run between 'InitCsets' and 'BreakRevCsetCycles' (i.e. changeset creation and first breaker pass). It computes the changeset dependencies from the file-level dependencies once and saves the result in the state, in the new table 'cssuccessor'. Now the breaker and sort passes can get the information quickly, with virtually no effort. The dependencies are recomputed incrementally when a changeset is split by one of the breaker passes, for its fragments and its predecessors.

The loop check is now trivial, and integrated into the successor computation, with the heavy lifting for the detailed analysis and reporting moved down into the type-dependent SQL queries. The relevant new method is 'loops'. Now that the loop check is incremental the pass based checks have been removed from the integrity module, and the option '--loopcheck' has been eliminated. For paranoia the graph setup and modification code got its loop check reinstated as an assert, redusing the changeset report code.

Renumbered the breaker and sort passes. A number of places, like graph setup and traversal, loading of changesets, etc. got feedback indicators to show their progress.

The selection of revision and symbol changesets for the associated breaker passes was a bit on the slow side. We now keep changeset lists sorted by type (during loading or general construction) and access them directly.

Timelines: ancestors | descendants | both | trunk

Other Links: files | ZIP archive | manifest

SHA1 Hash:	00bf8c198ee6db85e9ec3868df1b6649695ae0e3
Date:	2007-12-02 20:04:40
User:	aku
Comment:	The performance was still not satisfying, even with faster recomputing of successors. Doing it multiple times (Building the graph in each breaker and sort passes) eats time. Caching in memory blows the memory. Chosen solution: Cache this information in the database. Created a new pass 'CsetDeps' which is run between 'InitCsets' and 'BreakRevCsetCycles' (i.e. changeset creation and first breaker pass). It computes the changeset dependencies from the file-level dependencies once and saves the result in the state, in the new table 'cssuccessor'. Now the breaker and sort passes can get the information quickly, with virtually no effort. The dependencies are recomputed incrementally when a changeset is split by one of the breaker passes, for its fragments and its predecessors. The loop check is now trivial, and integrated into the successor computation, with the heavy lifting for the detailed analysis and reporting moved down into the type-dependent SQL queries. The relevant new method is 'loops'. Now that the loop check is incremental the pass based checks have been removed from the integrity module, and the option '--loopcheck' has been eliminated. For paranoia the graph setup and modification code got its loop check reinstated as an assert, redusing the changeset report code. Renumbered the breaker and sort passes. A number of places, like graph setup and traversal, loading of changesets, etc. got feedback indicators to show their progress. The selection of revision and symbol changesets for the associated breaker passes was a bit on the slow side. We now keep changeset lists sorted by type (during loading or general construction) and access them directly.
Timelines:	ancestors \| descendants \| both \| trunk
Other Links:	files \| ZIP archive \| manifest

Tags And Properties

branch=trunk inherited from [a28c83647d]
sym-trunk inherited from [a28c83647d]

Changes

[show diffs]

Modified tools/cvs2fossil/lib/c2f_cyclebreaker.tcl from [6e157515ed] to [775fd1f9e5]. [diff]

Modified tools/cvs2fossil/lib/c2f_integrity.tcl from [3a6b91462b] to [3028615e2a]. [diff]

Modified tools/cvs2fossil/lib/c2f_option.tcl from [b6d7645a3c] to [5835c5aa1e]. [diff]

Modified tools/cvs2fossil/lib/c2f_patopsort.tcl from [271b9b7ee3] to [bd713af4f1]. [diff]

Modified tools/cvs2fossil/lib/c2f_pbreakacycle.tcl from [f65b1a9322] to [9244bb5c27]. [diff]

Modified tools/cvs2fossil/lib/c2f_pbreakrcycle.tcl from [0b1951c1de] to [3c073e957a]. [diff]

Modified tools/cvs2fossil/lib/c2f_pbreakscycle.tcl from [427766d2fb] to [24924cb693]. [diff]

Modified tools/cvs2fossil/lib/c2f_pinitcsets.tcl from [f56c12b551] to [ced4d957b1]. [diff]

Modified tools/cvs2fossil/lib/c2f_prev.tcl from [c123dc0a3e] to [bf483d028a]. [diff]

Modified tools/cvs2fossil/lib/c2f_prtopsort.tcl from [b280cf33d2] to [108eb140ec]. [diff]

Modified tools/cvs2fossil/lib/cvs2fossil.tcl from [fe8a4a6dae] to [fb15e077e1]. [diff]

Modified tools/cvs2fossil/lib/pkgIndex.tcl from [d37efe5d62] to [bba80efcbb]. [diff]