575655b6a4
Makes db thread-safe
...
It was needed for simplicity and various optimization
2016-01-25 13:14:31 +01:00
594598ed6b
Adds list of author computation
2016-01-25 13:13:57 +01:00
88ab821c58
Adds a static website
2016-01-25 10:08:56 +01:00
5e83b3941d
Forces the use of version v0
2016-01-22 19:20:08 +01:00
8903f36238
Fixes lock
2016-01-22 19:19:08 +01:00
6ef506b0ea
Plays with logging
2016-01-22 18:48:12 +01:00
644fb09806
Adds a BatchSize option
2016-01-22 18:19:24 +01:00
1699bca7cd
Fixes a stupid bug
...
================================================================================
========================= B I G H I N T =========================
================================================================================
Y O U N E E D T D D
2016-01-22 18:17:19 +01:00
f407c1cf3e
Implements a basic main function
2016-01-22 18:06:33 +01:00
fe6e32ec7b
Makes the CoverCache use diskv
...
because in memory cache is Aaaawwwweeeessssooomme
2016-01-21 22:19:37 +01:00
4a18666fe2
Implements the database
2016-01-21 20:24:36 +01:00
40e1e55215
Adds tests for AlbumDatabase
2016-01-21 19:34:58 +01:00
ef458eaaea
Splits bleve.Index and database in two
2016-01-21 19:19:04 +01:00
b044fa17ab
Implements a new main
2016-01-21 18:54:46 +01:00
2516bcb128
Reports all results
2016-01-21 18:54:24 +01:00
0d3e8b922a
Refactors the indexing and the syntax
...
Human queries are now in french. Sorry for that
2016-01-21 16:36:45 +01:00
dc0830a559
Cleans the tests
2016-01-21 14:09:01 +01:00
925a0a21ed
Adds an indexer
2016-01-21 10:00:17 +01:00
be5c34b2a6
Removes author
2016-01-21 10:00:00 +01:00
f3d69cb3d0
Fixes data
2016-01-21 09:59:15 +01:00
c6a16804cc
Cleans doc
2016-01-21 09:58:37 +01:00
5a44613055
Skips long test
...
By default they will be skipped, `make LONG=1` will run them
2016-01-20 16:04:58 +01:00
4520da662d
Adds test timing
2016-01-20 15:57:09 +01:00
c215dcb849
Makes album getter test pass
2016-01-20 15:31:05 +01:00
bc0e3a392b
Makes the AlbumCoverCache test works again
2016-01-20 15:31:05 +01:00
ea62247dad
Makes http request cached for tests
2016-01-20 15:31:05 +01:00
261c43184e
Adds some simple utilities for go thing
2016-01-20 15:30:39 +01:00
f6fbe8bd4e
Makes AlbumCsvReader use local testdata
2016-01-20 15:01:56 +01:00
120337dd1f
Adds a dump of data from www.bedetheque.com
2016-01-20 15:01:56 +01:00
40f3124d8a
Fixes the Description Getter
...
We need to store the URL now, for the AlbumCoverCache to work
2016-01-20 11:28:53 +01:00
2a4482d8f4
Makes the AlbumCsvParser a bit more safe
...
This d******* puts 00/0000 as a nil date sometimes, and for sure its
hard to parse !
We just replace it by a real 0 date
The csv from online.bdgest.com is a cat of 3 csv. Only the first one is
poulated in our case. We just ignore the new header line when we hit
them. We may report an io.EOF in the future !
2016-01-20 11:28:34 +01:00
4d049378cc
Adds a directory to cache test data
2016-01-20 09:23:16 +01:00
719a3cf82e
Merges Album and AlbumDescription
2016-01-20 09:22:41 +01:00
53b2d9c07b
Silently avoid empty description and note
2016-01-17 20:50:58 +01:00
56ee04e768
Tweak number of main explorer
2016-01-17 20:47:38 +01:00
15c40d70cc
Makes a loop to fetch everything
2016-01-17 20:33:40 +01:00
c070c63463
Adds HTTP Get rate limitation on cache
...
We don't want to have a large bandwidth on bedetheque.com, so the pace
at which we perform GET request is limited by a maximal number of
request over a window (per example no more than 10 request over 10
second)
If more request are required, the request is simply paused until we go
back within the limit ;). Go rulez !
2016-01-17 19:05:30 +01:00
b58b7e7e6a
Implements cahcing of album description and cover
2016-01-17 18:45:36 +01:00
105961a466
Adds a skeleton for an AlbumDescriptionCache
2016-01-17 13:13:27 +01:00
b743fffb23
Implements csv parsing
2016-01-17 12:58:59 +01:00
ab201424ad
Adds a skeleton for an AlbumCsvReader
2016-01-17 12:03:28 +01:00
150ce1e76e
Renames file to match type name
2016-01-16 19:08:49 +01:00
3d636d4cca
Implements a stupid crawler
2016-01-14 15:41:13 +01:00
f394ff0069
Implements URI guessing
2016-01-14 15:07:45 +01:00
21f6c21de4
Makes the sanitazition test pass
2016-01-14 14:15:01 +01:00
9854ec868a
Splits in two steps
2016-01-14 13:47:43 +01:00
01d8e1fabb
Adds test data for URI generation
2016-01-14 13:22:09 +01:00
89a975b2e4
Corrects the project description
2016-01-14 12:56:21 +01:00
87a165eb1a
Adds base type for our system
2016-01-14 12:56:21 +01:00
01642af48e
Base program skeleton
2016-01-14 12:49:45 +01:00
