Commit Graph

555 Commits

Author SHA1 Message Date
simon 04a559e471
refactor manual import task 2023-03-15 17:39:37 +07:00
simon 6b7354b14f
refactor reindex task 2023-03-15 16:59:20 +07:00
simon 2c719ae1ae
refactor download_pending task 2023-03-15 13:28:19 +07:00
simon 488711ee8f
refactor extract dl task 2023-03-14 16:40:05 +07:00
simon 78f04a2ffc
refactor subs rescan to new task manager 2023-03-14 15:42:42 +07:00
simon 58530563ce
fix empty is_pending 2023-03-14 15:07:01 +07:00
simon 2d2431364d
handle get single not found 2023-03-08 13:27:37 +07:00
simon 16440a4170
add generic task command handler 2023-03-08 12:31:03 +07:00
simon 1f08ea9eea
handle empty tasks return 2023-03-07 17:31:21 +07:00
simon 2850988bfe Merge branch 'testing' into feat-redis-result 2023-03-07 16:07:17 +07:00
simon ee568534f6
improve comment notify timeouts 2023-03-04 17:37:58 +07:00
simon c204c6ca7f
finetune timeouts and notifications 2023-03-04 17:03:46 +07:00
simon 87cfd9e154
move up notification for faster feedback 2023-03-04 16:45:14 +07:00
simon 72e5d7ccf8
disable expire for queue setup message 2023-03-04 11:51:48 +07:00
simon a459661fa2
fallback to estimate size for progress hook 2023-03-04 11:51:12 +07:00
simon a56de2818d
consolidate yt-dlp obs 2023-03-04 11:33:22 +07:00
simon 5617d1c7ae
sort by date and delete task results 2023-03-02 14:43:05 +07:00
simon 666074ed49
refactor download task, consolidate tasks 2023-03-02 14:17:03 +07:00
simon 4c0de78fb4
refactor subscribe from form task 2023-03-02 12:30:48 +07:00
simon ea002ad45d
refactor rescan and add to pending 2023-03-01 19:12:27 +07:00
simon 6328e316f4
add task manager integration 2023-03-01 18:13:51 +07:00
simon c4b175b2db
reindex simplify video meta unpack 2023-03-01 13:51:43 +07:00
simon b52aa4daba
fix media_url change in reindex, #424 2023-03-01 13:45:01 +07:00
simon 571c2ce3a4
ensure load_new_defaults for all manage.py commands, #434 2023-02-18 09:20:09 +07:00
simon a34c9479f2
use channel from queue for download query filtering, #431 2023-02-17 12:21:00 +07:00
simon 162c05628c
rename PendingInteract youtube_id kwargs 2023-02-17 10:26:10 +07:00
simon 1125c0c4bf
handle malformed thumbnail download, #430 2023-02-17 09:17:04 +07:00
simon 6641db3e7e
skip empty comment, #429 2023-02-13 12:42:55 +07:00
simon 77c26134d1
add print for thumbnail fallback, #425 2023-02-13 12:15:12 +07:00
simon ef685ecb42
handle PIL error empty thumbnail image, #425 2023-02-13 11:55:47 +07:00
simon 0fcd6c086b
add kip log output for is_upcoming or is_live 2023-02-10 22:16:04 +07:00
simon f8b0977a7f
fix linter 2023-02-03 14:57:57 +07:00
simon 3f86786ee8
reduce comments log output 2023-02-02 14:14:32 +07:00
simon 2d942fe9b5
load defaults for schedule builder at startup 2023-02-02 13:06:00 +07:00
simon 114c7c2811
return new version in is_updated 2023-02-02 12:06:24 +07:00
simon 83057d9e54
return files clearded from clear_dl_cache 2023-02-02 10:46:59 +07:00
simon cacf6e43b8
add envcheck and basic connection check startup command 2023-01-28 08:37:58 +07:00
simon 4d65d45a59
disable shorts or streams for channels, #405 2023-01-16 09:51:03 +07:00
simon 5d0689abba
fix startup schedule builder for new installs, #408 2023-01-16 09:13:58 +07:00
simon c0e36133a1
remove timeouts on ES connection 2023-01-14 13:21:50 +07:00
simon d6a861118f
better watched state log output 2023-01-14 08:51:10 +07:00
simon 18a4484fa8
fix reindex logic when not using cookies 2023-01-13 15:19:11 +07:00
simon 092c467a2e
default to videos vid_type in get_youtube_details 2023-01-12 16:49:45 +07:00
simon 8db361cc88
channel fullscan to fix vid_type in refresh task 2023-01-11 23:06:02 +07:00
simon 00d7c33af6
randomize version_check schedule 2023-01-11 22:00:44 +07:00
simon 9a526f93f4
fix reindex active_key 2023-01-07 15:53:32 +07:00
simon d5885273ac
detect any shorts before adding to queue 2023-01-07 15:41:11 +07:00
simon db4798754a
match streams type with was_live 2023-01-07 09:58:53 +07:00
simon 646bc1b12e
filter by vid_type for add to download queue 2023-01-07 09:45:01 +07:00
simon d9f73622a5
refactor UrlParser into own module, rename enum fields 2023-01-06 15:37:55 +07:00
simon e299308711
match VideoTypeEnum with yt channel paths 2023-01-06 10:11:52 +07:00
simon eccad8968b
add unknown field to VideoTypeEnum 2023-01-04 11:54:39 +07:00
simon 72e9234b2b
fix playlist validator only validating active playlists 2023-01-04 08:24:18 +07:00
simon eb812d2b0a
add timeouts 2023-01-02 22:16:20 +07:00
simon ce4288ff66
add is_short standalone helper function 2023-01-02 21:36:08 +07:00
simon 46229db64c
[API] add download now endpoint, fix vid_type 2023-01-02 16:50:53 +07:00
simon d690c4591c Merge branch 'master' into testing 2023-01-02 10:11:53 +07:00
Chance Turner 98f5b66826
Lives and shorts (#395)
* Initial shot at adding in live and short videos

* Fix for typo on config variable names

* Remove was_live youtube flag

* Adding startup script to support setting vid_type on ta_video for videos created prior to support for live and shorts

* Linting updates

* More linting fixes

* Removing title variable from loop tuple unpacking
2023-01-02 10:11:06 +07:00
simon 43a41973d9
fix missing run method call 2022-12-31 16:06:33 +07:00
simon 00379bfe26
fix cookie validate bool logic 2022-12-31 15:35:58 +07:00
simon 34ed6ebc63
fix sponsorblock segments parser, #397 2022-12-31 11:17:11 +07:00
simon 73e1bba541
fix refactor codelist init 2022-12-23 23:00:35 +07:00
simon 599dd26b53
refactor comment interface into reusable CommentList class 2022-12-23 22:34:25 +07:00
simon 0b60377e19
cleanup, fix lint 2022-12-23 20:43:36 +07:00
simon 6ed2308f99
[API] add watched state endpoints 2022-12-23 20:39:14 +07:00
simon 09556dbf21
switch deleteQueue to API call 2022-12-22 19:57:19 +07:00
simon 470ecb007d
switch re-add to queue to API call 2022-12-22 19:48:24 +07:00
simon 8af10f8c07
switch ignore to API call 2022-12-22 19:42:59 +07:00
simon 7a9f5e5685
[API] add and use DELETE channel endpoint 2022-12-22 19:24:48 +07:00
simon bad4b48573
switch forget ignored to API call 2022-12-22 19:12:09 +07:00
simon db21ee8bcb
[API] add and use DELETE video endpoint 2022-12-22 19:01:13 +07:00
simon 63f35b19fe
register version_check schedule 2022-12-22 11:17:06 +07:00
simon ef44cb852c
add new version notification to UI 2022-12-21 18:26:32 +07:00
simon 5244cddeb3
add version_check background task 2022-12-21 14:24:24 +07:00
simon 4cccb73812
use timestamp() instead of strftime 2022-12-19 15:05:47 +07:00
simon e804dd1aec
continue indexing if comment indexing failes, #383 2022-12-19 14:59:07 +07:00
simon f45a3095cb
fix cast, use ENABLE_CAST env var to enable, #331 2022-12-19 14:43:10 +07:00
simon 71dd63d3f0
[API] implement refresh GET and POST endpoints 2022-12-19 11:24:37 +07:00
simon 21028d4e25
dict better REINDEX_CONFIG datatype 2022-12-12 18:21:31 +07:00
simon 2753ce93a2
add contains to RedisQueue 2022-12-12 18:01:02 +07:00
simon 0f6bc3a420
refactor check_reindex task for ReindexManual 2022-12-11 15:56:44 +07:00
simon 617790b68f
add ReindexManual to control reindex from API 2022-12-11 15:39:40 +07:00
simon 762a0fe8a1
add default sort _doc in IndexPaginate 2022-12-11 14:57:39 +07:00
simon 0d21bfe929
refactor Reindex to use RedisQueue 2022-12-11 12:03:21 +07:00
simon 49b120ed2b
refactor RedisQueue to take a queue_name arg 2022-12-10 14:51:17 +07:00
simon c06f6c68b4
fix empty comment reindex 2022-12-01 18:13:04 +07:00
simon f192c39be8
make snapshot before mapping changes 2022-11-27 18:01:57 +07:00
simon f1b89345e2
refactor ElasticBackup and ElasticIndex for better startup handling 2022-11-27 15:41:59 +07:00
simon f6c702fba7
refactor and run clear_dl_cache at startup 2022-11-25 18:49:36 +07:00
simon f619a5f72d
fi none existing unset channel overwrite, #362 2022-11-25 18:18:02 +07:00
simon d0124c1a5c
update yt-dlp, fix channel entries extractor 2022-11-22 19:11:58 +07:00
simon 5ed80d983d
fix deactivated comment extractor 2022-11-22 18:01:27 +07:00
simon 90258e75e6
add notification for comment indexing 2022-11-22 11:23:34 +07:00
simon b48b7c7e72
fix channel deactivation, take 2 2022-11-22 10:17:44 +07:00
simon 454d520394
standard video thumb path building 2022-11-21 15:50:01 +07:00
simon ebf53f6486
fix channel deactivation 2022-11-21 14:55:47 +07:00
simon b3d3ebe9d0
fix channel_last_refresh mapping for date math 2022-11-20 20:38:10 +07:00
simon d05c00aac6
fix playlist deactivate for refresh 2022-11-20 16:26:54 +07:00
simon 0c8fcbd724
use mapping to fix error for temp backup index 2022-11-20 16:13:30 +07:00
simon e101c4abc7
ignore unavailable index for snapshots 2022-11-20 12:33:39 +07:00