Simon
77fef5de57
fix standard duration str agg
2023-09-25 14:53:12 +07:00
0e767e2f84
Merge pull request #551 from ajgon/fix/elasticsearch-ha
...
Support elasticsearch clusters
2023-09-25 12:28:04 +07:00
Simon
7801ed0d60
fix find_results through SearchProcess
2023-09-25 10:14:14 +07:00
6abec9401b
Mute urlib3 ssl warnings when SSL verification is disabled
2023-09-23 15:00:46 +02:00
Simon
1cdb9e1ad5
refactor find_results use ElasticWrap directly
2023-09-22 23:54:31 +07:00
Simon
7afeb41469
use SearchProcess for single_lookup
2023-09-22 21:51:27 +07:00
Simon
bae11fe1f1
fix appconfig init
2023-09-22 21:27:38 +07:00
Simon
0cacaee213
merge testing
2023-09-22 21:22:32 +07:00
Simon
892e81c185
refactor ElasticWrap dynamic kwargs
2023-09-22 20:35:14 +07:00
f423ddc53a
add healthcheck endpoint ( #553 )
2023-09-22 15:01:47 +07:00
b2bb7ea28e
Support wider spectrum of ElasticSearch configurations
2023-09-22 09:50:47 +02:00
Simon
92975a5c95
disable ta_config indexing
2023-09-21 23:16:06 +07:00
a5b61bfaf6
Add "Mark Unwatched" to channels and playlists ( #547 )
2023-09-21 22:40:42 +07:00
85b56300b3
Move user configuration from Redis to ES ( #533 )
...
* ES Client must bootstrap itself to be the source of config
If this is not done a cyclic loop is created between the config loader and the ES client.
This lays the ground work for ES being the source of all app config.
* auto_download is not used anymore
* Add UserConfig class that encapsulates user config storage
This class will allow the rest of the code to 'not care' about how user properties are stored.
This requires the addition of a ta_users index in ES.
* Create migration task for user config transfer
* Replace getters and setters for each property
Strongly type the user configuration
Migrate missed sponsorblock ID
* Other DB settings will be another PR
2023-09-21 21:46:55 +07:00
Simon
a7fc7902f0
refactor single video page to use SearchProcess
2023-09-04 21:43:09 +07:00
Simon
879f5ab52f
refactor match_progress to use SearchProcess
2023-09-04 21:05:29 +07:00
Simon
47c433e7c1
refactor search form to use new SearchProcess
2023-09-04 20:22:00 +07:00
Simon
dc41e5062d
refactor duration class into separate helper functions
2023-09-04 18:49:10 +07:00
317942b7e1
Refac biggest channels to be 3 seperate tables with ordering and right align ( #536 )
...
* Add right align to numbers on biggest channels in dashboard
* Refac biggest channels to be 3 seperate tables with ordering
* Fix aggs linting
2023-09-04 17:51:06 +07:00
65d768bf02
Fix url to settings documentation ( #535 )
2023-09-04 17:24:48 +07:00
Simon
fa45cf08ba
fix mobile table layout
2023-09-02 17:37:28 +07:00
Simon
0c9c88fc0b
buildStats async
2023-09-02 16:31:43 +07:00
Simon
725bba0963
add randint sleep before version check
2023-09-02 16:02:04 +07:00
Simon
76981635dc
reset autostart on queue stop, #520
2023-09-02 12:06:43 +07:00
Simon
4016e81f9a
add download history stats
2023-09-02 11:22:03 +07:00
Simon
5ee37eb0cb
add biggest chanel aggs
2023-09-01 09:28:56 +07:00
Simon
4650963cc7
add watch progress tiles
2023-08-31 22:28:36 +07:00
Simon
505f5b73c5
add primary aggs
2023-08-31 14:34:08 +07:00
Simon
52d6c59f3f
fix incomplete messages outside of sendprogress task method
2023-08-31 12:16:42 +07:00
Simon
4afb605736
show all messages on settings pages
2023-08-31 12:16:17 +07:00
fcc1c2a648
Split the settings page ( #528 )
...
* Split the settings page
* Add a dashboard page for future use
Create a settings base to keep all the settings pages consistent
* Correct Python formatting
* Fix snapshots not showing in new view
2023-08-31 11:11:31 +07:00
Simon
58ef8f753f
fix date epoch sec format
2023-08-30 11:54:02 +07:00
Simon
41f6a03751
fix typing
2023-08-25 15:00:03 +07:00
Simon
68928f5cb1
ignore eaDir folder, use ignore_filelist for clear_dl_cache, #523
2023-08-24 00:02:58 +07:00
Simon
a514dda1ff
[API] implement delete playlist endpoint
2023-08-23 23:54:36 +07:00
Simon
2bccb698e6
remove legacy process subscribe methods
2023-08-23 23:34:19 +07:00
Simon
076452c612
move subscribe buttons to API calls
2023-08-23 23:28:09 +07:00
Simon
a2eb42ebb9
validate subscribe url type, #299
2023-08-23 21:22:09 +07:00
Simon
3803537739
trigger bgsave on importent redis set_message
2023-08-23 18:35:20 +07:00
Simon
58818bb91c
better thumbnail final fall back handling
2023-08-22 18:12:21 +07:00
Simon
8411889db7
add type hints to filesystem scanner
2023-08-09 09:45:51 +07:00
Simon
fa43753614
better error handling in comment extraction
2023-08-05 09:53:21 +07:00
Simon
02be39b6ed
hide/reveal apprise links
2023-08-01 00:30:11 +07:00
Simon
c395a949cc
add localhost and tubearchivist to default trusted
2023-07-30 00:13:15 +07:00
Simon
4473e9c5b2
add apprise notifications
2023-07-29 23:41:54 +07:00
Simon
aea403a874
additional thumb dl error handling
2023-07-28 18:19:22 +07:00
Simon
6f915a5733
fix channel tv art extraction
2023-07-28 16:34:39 +07:00
Simon
f970ec867e
clarify subtitle language codes on settings page, #505
2023-07-28 16:10:52 +07:00
Simon
ef0d490890
[API] change dates to ISO format
2023-07-28 15:56:59 +07:00
865089d46d
Resolve #502 by making the extension lowercase before comparison. ( #504 )
...
* Resolve #502 with making the extension lowercase.
Add note to `EXT_MAP` reference.
* Fixed comment for linting, added more details.
2023-07-27 21:01:53 +07:00
Simon
434aa97a86
static cache file path building, #498
2023-07-24 23:44:27 +07:00
Simon
efde4b1142
skip subtitle if not processed yet, #496
2023-07-24 12:11:21 +07:00
1be80b24c2
Implement #490 - Add version API and add local_version function. ( #491 )
...
* Add version API and add local_version function.
* Minor adjustments for linting.
* Add missing newlines for linter.
* Add missing comma to `urls.py`.
* Remove `version/` endpoint.
* Remove the `VersionView`.
* Prepare `PingView` for removal of the `is_static` response.
* Remove the `is_unstable` response from `ReleaseVersion`.
* Readd missing class instantiation for first call of `ReleaseVersion`.
2023-06-28 10:50:28 +07:00
Simon
061c653bce
retry get config better startup error handling, #485
2023-06-23 00:15:07 +07:00
Simon
72a98b0473
handle missing channel_tvart_url in thumb validator, #479
2023-06-22 23:36:54 +07:00
Simon
88e199ef9c
reset reindex counter on new added to queue, #478
2023-06-22 23:29:05 +07:00
Simon
103409770d
temporary fix for is_favorited extraction error
2023-06-22 23:27:16 +07:00
Simon
247808563a
download error recovering
2023-06-16 15:47:38 +07:00
simon
6fb788b259
add delete button for unavailable video
2023-05-22 17:34:49 +07:00
simon
5e92d06f21
fix dl error retry logic, store and return error, #477
2023-05-20 21:25:50 +07:00
simon
7082718c14
add days to seconds string converter
2023-05-20 20:08:36 +07:00
simon
7e2cd6acd3
fix linter, take 2
2023-05-20 19:41:33 +07:00
simon
904d0de6aa
fix linter
2023-05-20 19:37:41 +07:00
simon
139d20560f
remove unused channel folder refresh
2023-05-20 16:30:19 +07:00
simon
66a14cf389
remove unused clean_string
2023-05-20 16:08:43 +07:00
simon
9b30c7df6e
refacter filesystem scanner
2023-05-20 16:07:33 +07:00
simon
5334d79d0d
default query
2023-05-20 15:38:55 +07:00
simon
8ef59f5bff
delete channel path building
2023-05-18 20:32:58 +07:00
simon
9d6ab6b7b3
implement new media_url
2023-05-18 20:32:37 +07:00
simon
918a04c502
allow empty data for paginate
2023-05-18 17:01:07 +07:00
simon
60f1809ed8
fix rescan without task
2023-05-17 23:24:47 +07:00
simon
f848e73251
HOTFIX: default bitrate, #415
2023-05-14 08:01:15 +07:00
simon
a9b5713629
add channel tags to searching
2023-05-07 20:46:46 +07:00
simon
dbaa13bfb0
apply auto_start sort to dl queue
2023-05-07 19:41:37 +07:00
simon
5d0d050149
fix channel reindex flow
2023-05-07 17:45:48 +07:00
simon
774780d520
fix filesystem rescan without task
2023-05-07 15:36:26 +07:00
simon
4376b826c4
add auto tag to video in queue
2023-05-07 12:06:38 +07:00
simon
0d2d3353a9
add extractor lang, #316
2023-05-07 09:47:03 +07:00
simon
b47687535a
undo faulty channel sync to videos
2023-05-05 19:21:09 +07:00
simon
170839362e
fix ignoring progress message when not initiated with task
2023-05-04 11:48:38 +07:00
simon
b95a659396
fix empty channel_subs parsing
2023-05-02 12:42:35 +07:00
simon
2b66786728
switch channel index to yt-dlp, index tags
2023-05-02 11:45:34 +07:00
simon
b7bfeaf215
add channel tags to mapping
2023-05-02 11:44:51 +07:00
simon
63021bd313
add autostart subs to config form
2023-04-29 16:54:54 +07:00
simon
cbcb7484a7
Merge branch 'feature/queue-autorun' into testing
2023-04-29 16:41:19 +07:00
1c0b407f3f
Allow to configure yt-dlp `--format-sort` argument ( #471 )
...
* Allow to configure yt-dlp `--format-sort` argument
This exposes the [`--format-sort`][1] yt-dlp option to the user.
Implements parts of #316
[1]: https://github.com/yt-dlp/yt-dlp#sorting-formats
* Trim split values of format_sort, obey black
* Add `format_sort` to default configuration
* Add note about codec compatibility to settings page
2023-04-29 16:32:52 +07:00
simon
280c773441
add download now to form
2023-04-29 14:17:36 +07:00
simon
efca460e9d
download now task handling
2023-04-29 13:22:10 +07:00
simon
8f3b832069
[API] add dl autostart query param
2023-04-29 12:55:12 +07:00
simon
9b3d1fa1fd
Merge branch 'testing' into feature/queue-autorun
2023-04-29 08:33:55 +07:00
9a38aff03d
Accept members-only/paid-content playlist IDs/URLs ( #469 )
...
This adds a new check to the playlist url_id check to allow playlist urls from subscription only content on youtube channels.
The channel I tested on had an ID length of 26 (https://www.youtube.com/playlist?list=UUMOvk0KB4Ue0vfPqvDzjIAwiQ ), I am not sure if other lengths are valid here also.
I have tested this on my local install and it is downloading the members only playlist correctly as long as I have valid youtube cookies.
2023-04-28 10:20:49 +07:00
simon
06bbe2e400
fix playlist sub parser
2023-04-27 22:06:41 +07:00
simon
77900f89e3
remove legacy limit_count config
2023-04-23 13:59:32 +07:00
simon
bc39561606
consolidate dl queue notification to method
2023-04-22 13:42:54 +07:00
simon
76535c6304
move add to queue to api call
2023-04-22 11:57:09 +07:00
simon
89779ec13b
consolidate update status priority
2023-04-21 17:25:04 +07:00
simon
1b6b219e02
modify _get_next to for auto_only attr
2023-04-21 16:11:37 +07:00
simon
3a091ac287
implement auto_start indexing
2023-04-16 18:30:39 +07:00
simon
e385331f6c
add typing
2023-04-16 13:59:15 +07:00
simon
4067b6c182
add channel aggs
2023-04-15 22:55:30 +07:00
simon
a17f05ef21
index streams and file size
2023-04-15 17:45:20 +07:00
simon
a4d42573ef
move DurationConverter to separate module
2023-04-13 17:29:17 +07:00
simon
82d873a70f
add members link to rescan task
2023-04-10 11:16:37 +07:00
simon
7e4f564f45
fix title overwrite in notification
2023-04-10 10:25:09 +07:00
simon
3f7b38713f
add more progress notification for zip backup
2023-04-09 14:29:13 +07:00
simon
0b33edcb4c
tweak thumb resync paginate size
2023-04-09 14:23:10 +07:00
simon
06c7968070
fix silly host_clean and direct access TA_PASSWORD
2023-04-09 13:35:13 +07:00
simon
a98a30cc85
elaborate TA_HOST parsed, #441
2023-04-09 13:27:47 +07:00
simon
a924d648d6
add video id to processing message
2023-04-09 12:42:46 +07:00
simon
5d524e5110
fix reindex notification filter
2023-04-08 17:18:42 +07:00
simon
d2649c29c3
add recent videos to reindex queue task
2023-04-08 16:00:16 +07:00
simon
ff89432d86
fix off by one task notification error
2023-04-08 14:28:03 +07:00
simon
fb77ab44ee
fix manual import media file permission, add missing comment check trigger
2023-04-07 19:51:40 +07:00
simon
e43840da31
fix manual index folder permission
2023-04-07 19:41:53 +07:00
simon
3fa5ed725e
fix missing progress script for channel notification
2023-04-07 19:29:21 +07:00
simon
841f5ab67f
fix missing tvart fallback key
2023-04-07 19:14:25 +07:00
simon
4038a837cf
fix chown for subtitles
2023-04-07 13:11:40 +07:00
simon
5b2d7db102
fix chown for channel folder creation
2023-04-07 12:47:33 +07:00
simon
c8dd391fd3
fix channel tv art validator callback
2023-04-07 09:09:32 +07:00
simon
780115adb6
download and index channel tv art
2023-04-05 21:49:03 +07:00
simon
0b300e7e12
replace all old wiki links to new docs
2023-03-31 23:46:49 +07:00
simon
ee4dbf99b3
add type hints
2023-03-31 13:15:30 +07:00
simon
981a4cb8b3
clear queue on stop
2023-03-31 10:09:54 +07:00
simon
2a0a04ac65
cleanup notifications
2023-03-30 18:20:53 +07:00
simon
db0ade203a
return task commands to notification backend
2023-03-30 11:39:22 +07:00
simon
2b8012b5d4
return command to task
2023-03-24 10:41:33 +07:00
simon
81701df1c7
speed up comments and channel extraction by disabling format test
2023-03-24 10:21:38 +07:00
simon
df9a52a8f2
speed up add to queue by disabling format check
2023-03-24 09:57:09 +07:00
simon
19c853f07b
fix message trunct
2023-03-23 12:20:12 +07:00
simon
8cf41a4043
merge redis backend branch into testing
2023-03-23 11:35:46 +07:00
simon
0e726af2de
switch task creation to api posts
2023-03-23 11:28:42 +07:00
simon
f304c2eb02
remove legacy kill_dl task
2023-03-23 10:59:00 +07:00
simon
2bc92c9095
handle on_failure task callback
2023-03-23 10:57:15 +07:00
simon
33b9a012d4
implement api-stop for download_pending
2023-03-23 10:48:43 +07:00
simon
860213c427
fix empty reply
2023-03-23 09:57:16 +07:00
simon
272972429b
handle hard task reset at startup
2023-03-23 09:49:06 +07:00
simon
db0e362b7d
make update_subscribed stoppable
2023-03-22 17:01:34 +07:00
simon
3bd6075a9b
[API] remove old task endpoint add task-name and task-id
2023-03-22 16:35:25 +07:00
simon
11a61a06a6
simplify view import
2023-03-20 15:23:30 +07:00
simon
3f96b37b51
fix notification data attr
2023-03-20 11:29:04 +07:00
simon
4f89a0696b
remove legacy progress view
2023-03-19 17:28:13 +07:00
simon
3f4d0c0c76
change message groups
2023-03-18 20:24:28 +07:00
simon
73c82a91c0
use task notification for already running
2023-03-18 18:00:38 +07:00
simon
f194259ab3
refactor subscribe task backend
2023-03-18 17:46:51 +07:00
simon
3b9d083f5e
notify only if task attr is set
2023-03-18 17:13:14 +07:00
simon
b2fa92a8c3
refactor channel playlist index task backend
2023-03-18 12:59:16 +07:00
simon
d533c7acfe
refactor re_sync_thumbs task
2023-03-16 18:13:37 +07:00
simon
e6da63ff09
clean up notification
2023-03-16 18:11:08 +07:00
simon
461c2c4600
refactor thumbnail check task
2023-03-16 17:12:50 +07:00
simon
0ab41f74dc
refactor filesystem class task
2023-03-16 13:18:26 +07:00
Simon
Simon
Igor Rzegocki
Igor Rzegocki
Joseph Liu
Clark
Merlin
lamusmaser
Dominik Sander
Matthew Glinski