83 Commits
Author SHA1 Message Date
Thomas von Dein 0d5ee0b485 pin to older release, see woodpecker-plugins/docker-buildx#306 2026-01-07 10:39:38 +01:00
Thomas von Dein b6350344be fix image links 2025-11-05 08:56:20 +01:00
Thomas von Dein e5ff2bbc5c fix changelog link 2025-11-05 08:45:12 +01:00
Thomas von Dein 287b9995fe update go to 1.24 2025-10-02 22:35:13 +02:00
Thomas von Dein dd45dc996b ifix go version 2025-05-04 20:40:29 +02:00
Thomas von Dein 1d5aa50423 fix go versions 2025-05-04 12:36:37 +02:00
Thomas von Dein eff0af0b34 pie only on linux 2025-02-19 18:08:15 +01:00
Thomas von Dein 34b1ad9d1e remove symbols and crap from released binaries 2025-02-19 18:01:05 +01:00
Thomas von Dein cd3d00adbe add changelog builder, update release builder 2025-02-05 17:54:47 +01:00
Thomas von Dein 528ecdd43d updated deps 2025-02-01 18:04:25 +01:00
Thomas von Dein 9e2983a85c build release binaries using ci workflow 2025-01-18 10:53:41 +01:00
Thomas von Dein 6eddd08e4a added warning about security update 2025-01-17 12:22:20 +01:00
Thomas von Dein 34dfc25e87 bump version 2025-01-17 12:00:21 +01:00
Thomas von Dein 475a9a2fd3 add test files in other formats 2025-01-06 18:42:19 +01:00
Thomas von Dein fbd9a5a621 make clear that this is not the complete filename 2025-01-06 18:42:19 +01:00
Thomas von Dein 7014c97dee added image formats test 2025-01-06 18:42:19 +01:00
Thomas von Dein 91edfeb19a support hashing with all formats 2025-01-06 18:42:19 +01:00
Thomas von Dein 3b3435515c check seek err 2025-01-06 18:42:19 +01:00
Thomas von Dein 2239a83f76 properly check image format for storing and distance hashing 2025-01-06 18:42:19 +01:00
Thomas von Dein 31b27beee5 fix error handling when trying to open files 2024-12-13 11:23:24 +01:00
Thomas von Dein 07ebd7afad bump version 2024-11-01 12:21:04 +01:00
Thomas von Dein c9a75e3f91 bump version 2024-10-02 10:52:24 +02:00
Thomas von Dein e4edde082b bump version 2024-09-25 15:43:15 +02:00
Thomas von Dein d7f5fbbe58 update other actions as well 2024-09-25 15:13:41 +02:00
Thomas von Dein ee550b1ed7 use normal Error() func 2024-09-25 15:08:34 +02:00
Thomas von Dein e35815f27f Update golang-ci linter 2024-09-25 15:05:44 +02:00
Thomas von Dein 9138770d6e added dependabot config 2024-09-25 14:56:47 +02:00
Thomas von Dein 834fbcd9c5 check return of ReadString() 2024-04-26 13:42:28 +02:00
Thomas von Dein 4c10ae89f8 bump version 2024-04-26 13:42:28 +02:00
Thomas von Dein df6fc47ca3 fix #88: respond accordingly when user double clicks kleingebaeck.exe 2024-04-26 13:42:28 +02:00
Thomas von Dein 5956a68e72 minor critics corrected 2024-04-26 13:42:28 +02:00
Thomas von Dein eee0167574 added 2024-04-26 13:42:28 +02:00
Thomas von Dein a3b2748479 fix #87: document image distance hash 2024-04-26 13:42:28 +02:00
Thomas von Dein 8cc5a9e3ed missed commits 2024-02-12 13:36:29 +01:00
Thomas von Dein d2bcd7b505 fix #80: using os.MkdirAll():
Recursively create ad dir including output dir. The output dir itself
is not being created separately anymore. That way, no directory will
be created if no ads could be downloaded.
2024-02-12 13:32:25 +01:00
Thomas von Dein c59c2e2931 fix #81: add arm64 build support 2024-02-12 13:32:25 +01:00
Thomas von Dein 2288806105 fix #77: use processed ad dir for duplicate checking, not slug 2024-02-10 15:15:43 +01:00
Thomas von Dein 5a2c277f0e fix #71 and #73: add support for outdir template and enhance docs 2024-02-10 14:44:09 +01:00
Thomas von Dein 612ed2aa79 fix #74: warn if about to write to already visited ad, overwrite if -f 2024-02-10 14:44:09 +01:00
Thomas von Dein ed78731b3c check seek error 2024-01-27 17:34:44 +01:00
Thomas von Dein a84f0e1436 get rid of duplicate bytes.Buffer, use bytes.Reader instead, #39 2024-01-27 17:34:44 +01:00
Thomas von Dein d8d5be5c7d fix #58: add missing dashes to self issue template 2024-01-27 17:34:44 +01:00
Thomas von Dein bcf920c91e correct #39 add --ignoreerrors flag 2024-01-27 17:34:44 +01:00
Thomas von Dein 9cd1fc0596 behavior changes: UserAgent configurable, test cookies, check errors 2024-01-24 19:22:31 +01:00
Thomas von Dein 8df3ebfa6d add throttling to image download 2024-01-24 19:22:31 +01:00
Thomas von Dein de82127223 first step in fixing #49:
fetch cookies from 1st response and use them in subsequent requests.
2024-01-24 19:22:31 +01:00
Thomas von Dein a79a28f4a1 add contribution guidelines and non-code-of-conduct 2024-01-23 18:01:14 +01:00
Thomas von Dein 95b1172b7f fix typo 2024-01-23 17:26:06 +01:00
Thomas von Dein 6f3954f1c0 added issue templates and fix make show-versions 2024-01-23 14:20:33 +01:00
Thomas von Dein a465bbfaa8 Added german README, update docker docs, add latest image tag 2024-01-23 14:20:33 +01:00
Thomas von Dein ddae6ed8be bump version (feature update) 2024-01-22 18:43:44 +01:00
Thomas von Dein 8cced1f9e1 Fix #47: add mock http server for testing w/o hitting prod site 2024-01-22 18:43:44 +01:00
Thomas von Dein 3245438564 update yadu to v0.1.1, fix #46 2024-01-22 18:43:44 +01:00
Thomas von Dein 71c528114f fix linter error 2024-01-22 18:43:44 +01:00
Thomas von Dein e2afc1350b added -f to override d-hash, better debug and error handling 2024-01-22 18:43:44 +01:00
Thomas von Dein e971070f9f added image diff hash distance caching to not overwrite similar images 2024-01-22 18:43:44 +01:00
Thomas von Dein 0fd9b519d1 fixed changes on kleinanzeigen.de:
- Meta did not contain condition and category together anymore, they
removed  the category. Therefore fetching (that is, validation)
failed.
- Now we extract the condition and category directly.
- On top, category now includes the whole category tree.
- unit tests had to be tweaked for this measure.
2024-01-19 18:38:35 +01:00
Thomas von Dein 6b7f727449 fixed utf8 2024-01-19 18:38:35 +01:00
Thomas von Dein 5abbab9527 added template for ad directory, by default include id now 2024-01-19 18:38:35 +01:00
Thomas von Dein 1d2483d18f portable error check 2024-01-19 18:38:35 +01:00
Thomas von Dein b17f4f0f3e also added coverage report+badge 2024-01-19 18:38:35 +01:00
Thomas von Dein 4a91167871 put all tests into main_test.go, more failure mode tests and verify 2024-01-19 18:38:35 +01:00
Thomas von Dein 0baaf6f38b better error message on 404 2024-01-19 18:38:35 +01:00
Thomas von Dein 42182bb6c9 add commandline main() test units 2024-01-19 18:38:35 +01:00
Thomas von Dein 8455c193eb pass a io.Writer to loggers and outputs so we can test the cmdline 2024-01-19 18:38:35 +01:00
Thomas von Dein d1faa10a52 added more invalid tests 2024-01-19 18:38:35 +01:00
Thomas von Dein e28137bf9b upd httpmock+deps 2024-01-19 18:38:35 +01:00
Thomas von Dein 1ff5c240c8 put ad code into separate file, enhance error checking 2024-01-19 18:38:35 +01:00
Thomas von Dein 52b39d91a3 fix version finding + bump version 2024-01-19 18:38:27 +01:00
Thomas von Dein 3748cd35e5 fix #5: add exe extension to built windows binaries 2024-01-19 18:38:27 +01:00
Thomas von Dein 4d4577c9f8 fix #4, use filepath.Join to create portable path's 2024-01-19 18:38:27 +01:00
Thomas von Dein f932d7be83 re-orgainzied code a little, using go templates instead format string 2023-12-17 17:32:05 +01:00
Thomas von Dein e904ed6687 added custom template support, added more ad data, use concurrency 2023-12-16 20:32:10 +01:00
Thomas von Dein df6baadc85 better sample config 2023-12-16 00:01:29 +01:00
Thomas von Dein 314315a1c6 fix pod entities => markdown 2023-12-15 18:29:42 +01:00
Thomas von Dein 2e83e68f20 fix logo 2023-12-15 18:02:34 +01:00
Thomas von Dein b5e51b43c9 add logo 2023-12-15 18:00:41 +01:00
Thomas von Dein 1b55d887bc enhancements:
- english README (german version will be put to the homepage)
- better commandline options
- enhanced logging capabilities and error handling
- config file support
- support to backup one or more singular ads
- add id to adlisting
- added manual page
- fixed config file reading
- fixed typo
2023-12-15 17:19:44 +01:00
Thomas von Dein c2f378be05 fix link 2023-12-14 19:06:40 +01:00
Thomas von Dein 5b47128d0d added name 2023-12-14 19:03:18 +01:00
Thomas von Dein 5bd49db9ba scrape all ads 2023-12-14 19:02:32 +01:00
Thomas von Dein 7352159186 added release builder 2023-12-14 19:01:30 +01:00
Thomas von Dein 12329f6ae0 initial commit 2023-12-14 19:00:04 +01:00