c215dcb849
Makes album getter test pass
2016-01-20 15:31:05 +01:00
bc0e3a392b
Makes the AlbumCoverCache test works again
2016-01-20 15:31:05 +01:00
ea62247dad
Makes http request cached for tests
2016-01-20 15:31:05 +01:00
261c43184e
Adds some simple utilities for go thing
2016-01-20 15:30:39 +01:00
f6fbe8bd4e
Makes AlbumCsvReader use local testdata
2016-01-20 15:01:56 +01:00
120337dd1f
Adds a dump of data from www.bedetheque.com
2016-01-20 15:01:56 +01:00
40f3124d8a
Fixes the Description Getter
...
We need to store the URL now, for the AlbumCoverCache to work
2016-01-20 11:28:53 +01:00
2a4482d8f4
Makes the AlbumCsvParser a bit more safe
...
This d******* puts 00/0000 as a nil date sometimes, and for sure its
hard to parse !
We just replace it by a real 0 date
The csv from online.bdgest.com is a cat of 3 csv. Only the first one is
poulated in our case. We just ignore the new header line when we hit
them. We may report an io.EOF in the future !
2016-01-20 11:28:34 +01:00
4d049378cc
Adds a directory to cache test data
2016-01-20 09:23:16 +01:00
719a3cf82e
Merges Album and AlbumDescription
2016-01-20 09:22:41 +01:00
53b2d9c07b
Silently avoid empty description and note
2016-01-17 20:50:58 +01:00
56ee04e768
Tweak number of main explorer
2016-01-17 20:47:38 +01:00
15c40d70cc
Makes a loop to fetch everything
2016-01-17 20:33:40 +01:00
c070c63463
Adds HTTP Get rate limitation on cache
...
We don't want to have a large bandwidth on bedetheque.com, so the pace
at which we perform GET request is limited by a maximal number of
request over a window (per example no more than 10 request over 10
second)
If more request are required, the request is simply paused until we go
back within the limit ;). Go rulez !
2016-01-17 19:05:30 +01:00
b58b7e7e6a
Implements cahcing of album description and cover
2016-01-17 18:45:36 +01:00
105961a466
Adds a skeleton for an AlbumDescriptionCache
2016-01-17 13:13:27 +01:00
b743fffb23
Implements csv parsing
2016-01-17 12:58:59 +01:00
ab201424ad
Adds a skeleton for an AlbumCsvReader
2016-01-17 12:03:28 +01:00
150ce1e76e
Renames file to match type name
2016-01-16 19:08:49 +01:00
3d636d4cca
Implements a stupid crawler
2016-01-14 15:41:13 +01:00
f394ff0069
Implements URI guessing
2016-01-14 15:07:45 +01:00
21f6c21de4
Makes the sanitazition test pass
2016-01-14 14:15:01 +01:00
9854ec868a
Splits in two steps
2016-01-14 13:47:43 +01:00
01d8e1fabb
Adds test data for URI generation
2016-01-14 13:22:09 +01:00
89a975b2e4
Corrects the project description
2016-01-14 12:56:21 +01:00
87a165eb1a
Adds base type for our system
2016-01-14 12:56:21 +01:00
01642af48e
Base program skeleton
2016-01-14 12:49:45 +01:00
c34419e61e
initial commit
2016-01-14 12:04:07 +01:00
