Commit Graph

63 Commits

Author SHA1 Message Date
Simon e75ffb603c
fix auto delete lte datatype, #622 2023-12-16 13:13:48 +07:00
Clark 4d111aff82
Move the startup application settings to a new class (#571)
* Move the startup application settings to a new class

* Replace settings methods with static fields

* Move Redis and ES configuration to the settings class

* Fix environment python imports

* Update envcheck to use the new settings
2023-10-28 10:27:03 +07:00
Clark 85b56300b3
Move user configuration from Redis to ES (#533)
* ES Client must bootstrap itself to be the source of config

If this is not done a cyclic loop is created between the config loader and the ES client.
This lays the ground work for ES being the source of all app config.

* auto_download is not used anymore

* Add UserConfig class that encapsulates user config storage

This class will allow the rest of the code to 'not care' about how user properties are stored.
This requires the addition of a ta_users index in ES.

* Create migration task for user config transfer

* Replace getters and setters for each property

Strongly type the user configuration
Migrate missed sponsorblock ID

* Other DB settings will be another PR
2023-09-21 21:46:55 +07:00
Simon 76981635dc
reset autostart on queue stop, #520 2023-09-02 12:06:43 +07:00
Simon 4473e9c5b2
add apprise notifications 2023-07-29 23:41:54 +07:00
simon 5e92d06f21
fix dl error retry logic, store and return error, #477 2023-05-20 21:25:50 +07:00
simon 9d6ab6b7b3
implement new media_url 2023-05-18 20:32:37 +07:00
simon cbcb7484a7 Merge branch 'feature/queue-autorun' into testing 2023-04-29 16:41:19 +07:00
Dominik Sander 1c0b407f3f
Allow to configure yt-dlp `--format-sort` argument (#471)
* Allow to configure yt-dlp `--format-sort` argument

This exposes the [`--format-sort`][1] yt-dlp option to the user.

Implements parts of #316

[1]: https://github.com/yt-dlp/yt-dlp#sorting-formats

* Trim split values of format_sort, obey black

* Add `format_sort` to default configuration

* Add note about codec compatibility to settings page
2023-04-29 16:32:52 +07:00
simon bc39561606
consolidate dl queue notification to method 2023-04-22 13:42:54 +07:00
simon 1b6b219e02
modify _get_next to for auto_only attr 2023-04-21 16:11:37 +07:00
simon 7e4f564f45
fix title overwrite in notification 2023-04-10 10:25:09 +07:00
simon a924d648d6
add video id to processing message 2023-04-09 12:42:46 +07:00
simon 5b2d7db102
fix chown for channel folder creation 2023-04-07 12:47:33 +07:00
simon 981a4cb8b3
clear queue on stop 2023-03-31 10:09:54 +07:00
simon 33b9a012d4
implement api-stop for download_pending 2023-03-23 10:48:43 +07:00
simon b2fa92a8c3
refactor channel playlist index task backend 2023-03-18 12:59:16 +07:00
simon 2c719ae1ae
refactor download_pending task 2023-03-15 13:28:19 +07:00
simon c204c6ca7f
finetune timeouts and notifications 2023-03-04 17:03:46 +07:00
simon 72e5d7ccf8
disable expire for queue setup message 2023-03-04 11:51:48 +07:00
simon a459661fa2
fallback to estimate size for progress hook 2023-03-04 11:51:12 +07:00
simon a56de2818d
consolidate yt-dlp obs 2023-03-04 11:33:22 +07:00
simon e299308711
match VideoTypeEnum with yt channel paths 2023-01-06 10:11:52 +07:00
simon 72e9234b2b
fix playlist validator only validating active playlists 2023-01-04 08:24:18 +07:00
Chance Turner 98f5b66826
Lives and shorts (#395)
* Initial shot at adding in live and short videos

* Fix for typo on config variable names

* Remove was_live youtube flag

* Adding startup script to support setting vid_type on ta_video for videos created prior to support for live and shorts

* Linting updates

* More linting fixes

* Removing title variable from loop tuple unpacking
2023-01-02 10:11:06 +07:00
simon 73e1bba541
fix refactor codelist init 2022-12-23 23:00:35 +07:00
simon 599dd26b53
refactor comment interface into reusable CommentList class 2022-12-23 22:34:25 +07:00
simon 4cccb73812
use timestamp() instead of strftime 2022-12-19 15:05:47 +07:00
simon e804dd1aec
continue indexing if comment indexing failes, #383 2022-12-19 14:59:07 +07:00
simon 49b120ed2b
refactor RedisQueue to take a queue_name arg 2022-12-10 14:51:17 +07:00
simon 90258e75e6
add notification for comment indexing 2022-11-22 11:23:34 +07:00
simon a5be5a719b
reindex comments 2022-11-18 10:31:09 +07:00
simon 939cd7fb62
index comments as a DownloadPostProcess 2022-11-18 09:22:58 +07:00
simon baacd3ee39
better message for running and indexing queue 2022-10-23 12:21:27 +07:00
simon cc2fff8bef
use info_dict for message, simplify cache template, #271 2022-07-18 11:37:43 +07:00
simon b406250ae2
use shutil.copyfile for shutil.move calls 2022-07-17 07:47:27 +07:00
p0358 79996f6838
Fix permission/mount issues from #268 (#270)
* make nginx run as root within the container (#268)

* move file to videos path with fallback to regular copy with no metadata copying (#268)

* use `copy_function=shutil.copy` everywhere with `shutil.move`
2022-07-16 21:54:39 +07:00
simon 2cf30e1127
refactor: default set_message in RedisArchivist to True 2022-06-16 10:37:46 +07:00
simon 30abbe9be7
rewrite cookie into redis from io stream, auto validate 2022-06-15 17:54:05 +07:00
simon 88e526f5e5
refactor new YtWrap class for yt-dlp calls, #build
Changed:
- new yt-dlp base class
- new cookie class using io_stream
- MetadataFromField postprocessors
2022-05-25 16:15:38 +07:00
Clark 730ac15349
Fix #241 Use title/uploader for embedded metadata not Content ID (#252) 2022-05-25 16:13:25 +07:00
simon c39f8a9cb8
refactor use cookie io_stream 2022-05-24 15:51:58 +07:00
simon 4b00f454b7
integrate new YtWrap class in yt_dlp handler 2022-05-24 10:19:02 +07:00
simon 3722f11a65
cleanup cookie file after task 2022-05-07 09:34:51 +07:00
simon 1613b71942
hide cookie after rescan and download process 2022-05-03 17:32:32 +07:00
simon ca3ea20283
add socket_timeout when passing check_formats to yt-dlp 2022-05-02 09:48:52 +07:00
simon 088e87bccf
add cookiefile to PendingList and VideoDownloader 2022-04-30 17:27:57 +07:00
simon 43eec5aac0
move CookieHandler to separate module 2022-04-30 12:05:41 +07:00
simon 1fa26cdc44
added basic cookie import functionality 2022-04-23 21:59:59 +07:00
simon 59f1c111aa
extend timeout for sleep interval 2022-04-16 08:58:35 +07:00