summary |
shortlog | log |
commit |
commitdiff |
tree
first ⋅ prev ⋅ next
Helmut Grohne [Sat, 2 Mar 2013 21:29:04 +0000 (22:29 +0100)]
add sharing table
The sharing table is a cache for the /binary web pages. It essentially
contains the numbers presented. This caching table is not automatically
populated. It needs to be reconstructed after every (group of) package
imports.
Helmut Grohne [Sat, 2 Mar 2013 20:46:47 +0000 (21:46 +0100)]
update README
* Tell about schema.sql.
* Explain WAL.
Helmut Grohne [Sat, 2 Mar 2013 20:24:18 +0000 (21:24 +0100)]
move fetchiter from webapp to dedup.utils
Helmut Grohne [Sat, 2 Mar 2013 20:18:14 +0000 (21:18 +0100)]
move sql schema to a separate file
Helmut Grohne [Sat, 2 Mar 2013 10:25:53 +0000 (11:25 +0100)]
added html form to main page
Thanks to Jan Luehr for doing the work.
Helmut Grohne [Mon, 25 Feb 2013 10:56:09 +0000 (11:56 +0100)]
webapp: open database cursor lazily
Makes things more correct when using Application in multiprocessing
context.
Helmut Grohne [Mon, 25 Feb 2013 10:52:05 +0000 (11:52 +0100)]
webapp: pass database to Application class
Helmut Grohne [Mon, 25 Feb 2013 10:49:27 +0000 (11:49 +0100)]
README: another interesting query
Helmut Grohne [Mon, 25 Feb 2013 09:00:50 +0000 (10:00 +0100)]
Merge branch 'crosshash'
Conflicts in webapp.py:
* The fetchall -> fetchiter change caused big conflicts.
* New hash combination (image_sha512, image_sha512) added.
Helmut Grohne [Mon, 25 Feb 2013 08:55:35 +0000 (09:55 +0100)]
webapp: complete cross hash support
Helmut Grohne [Mon, 25 Feb 2013 07:55:53 +0000 (08:55 +0100)]
autoimport: this is not how foreign key constraints work
Helmut Grohne [Sun, 24 Feb 2013 00:03:30 +0000 (01:03 +0100)]
hash image contents
Helmut Grohne [Sun, 24 Feb 2013 00:02:38 +0000 (01:02 +0100)]
README: fix mistake
Helmut Grohne [Sat, 23 Feb 2013 08:53:33 +0000 (09:53 +0100)]
importpkg: ignore filenames with encoding errors
Helmut Grohne [Sat, 23 Feb 2013 08:36:15 +0000 (09:36 +0100)]
autoimport: log which packages are dropped
Helmut Grohne [Fri, 22 Feb 2013 18:59:00 +0000 (19:59 +0100)]
autoimport: fix version check to actually work
Don't fail on new packages and skip versions already processed again.
Helmut Grohne [Fri, 22 Feb 2013 18:55:31 +0000 (19:55 +0100)]
autoimport: skip old versions entirely
Presumably this is responsible for the blocking curl processes, since
importpkg will terminate early when processing an old version.
Helmut Grohne [Fri, 22 Feb 2013 17:33:22 +0000 (18:33 +0100)]
webapp: add caching headers
Helmut Grohne [Fri, 22 Feb 2013 17:21:44 +0000 (18:21 +0100)]
webapp: stream responses
Maybe this gets memory usage down for large responses.
Helmut Grohne [Fri, 22 Feb 2013 16:47:14 +0000 (17:47 +0100)]
webapp: attempt to reduce memory usage
Helmut Grohne [Fri, 22 Feb 2013 13:12:33 +0000 (14:12 +0100)]
webapp: support matching sha512 against gzip_sha512
This covers only the /binary page. The comparison may still be empty.
Helmut Grohne [Fri, 22 Feb 2013 06:24:05 +0000 (07:24 +0100)]
autoimport: first wait on the import
Otherwise the import zombifies and curl blocks.
Helmut Grohne [Thu, 21 Feb 2013 16:33:27 +0000 (17:33 +0100)]
move compression functions to module dedup.compression
Helmut Grohne [Thu, 21 Feb 2013 16:33:06 +0000 (17:33 +0100)]
do not track byted compiled python files
Helmut Grohne [Thu, 21 Feb 2013 16:10:54 +0000 (17:10 +0100)]
move hashing functions to module dedup.hashing
Helmut Grohne [Thu, 21 Feb 2013 14:31:51 +0000 (15:31 +0100)]
include maintainer information
Helmut Grohne [Thu, 21 Feb 2013 14:26:24 +0000 (15:26 +0100)]
added a base template to the webapp
Helmut Grohne [Thu, 21 Feb 2013 13:35:05 +0000 (14:35 +0100)]
added useful links to webapp
Helmut Grohne [Thu, 21 Feb 2013 07:53:06 +0000 (08:53 +0100)]
added README
Helmut Grohne [Thu, 21 Feb 2013 07:42:44 +0000 (08:42 +0100)]
rename test.py to importpkg.py
Helmut Grohne [Thu, 21 Feb 2013 07:41:56 +0000 (08:41 +0100)]
license as BSD-3
Helmut Grohne [Wed, 20 Feb 2013 21:33:54 +0000 (22:33 +0100)]
fix comparison of conflicting packages
Helmut Grohne [Wed, 20 Feb 2013 20:37:57 +0000 (21:37 +0100)]
reduce memory usage of autoimport
Helmut Grohne [Wed, 20 Feb 2013 20:24:12 +0000 (21:24 +0100)]
fix links in index
Helmut Grohne [Wed, 20 Feb 2013 20:12:58 +0000 (21:12 +0100)]
minimal index page explaining stuff
Helmut Grohne [Wed, 20 Feb 2013 18:04:18 +0000 (19:04 +0100)]
implement autoimport
Helmut Grohne [Wed, 20 Feb 2013 16:14:48 +0000 (17:14 +0100)]
mark required packages in binary view
Helmut Grohne [Wed, 20 Feb 2013 15:52:17 +0000 (16:52 +0100)]
store hard dependencies
Helmut Grohne [Wed, 20 Feb 2013 15:41:30 +0000 (16:41 +0100)]
determine metadata from control.tar.gz
Helmut Grohne [Wed, 20 Feb 2013 14:55:05 +0000 (15:55 +0100)]
teach ArReader to read multiple entries
Helmut Grohne [Wed, 20 Feb 2013 14:39:33 +0000 (15:39 +0100)]
cleanup
Helmut Grohne [Wed, 20 Feb 2013 14:28:04 +0000 (15:28 +0100)]
many improvements
* multiple hashes
* template engine
* new table package
* comparison view
* hashvalue view
Helmut Grohne [Wed, 20 Feb 2013 14:27:40 +0000 (15:27 +0100)]
first prototype