tubearchivist
/
tubearchivist
mirror of https://github.com/tubearchivist/tubearchivist.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
1,750 Commits 3 Branches 37 Tags 16 MiB
Commit Graph

1324 Commits

Author SHA1 Message Date
Simon 4a4a274259
bump requirements 2023-10-07 09:05:34 +07:00
Simon 0776cea7bc
fix backup for empty index 2023-10-07 09:05:17 +07:00
Simon 57d8b060d2
fix spelling 2023-10-03 21:03:31 +07:00
Simon 88f230c3f4
build yt-dlp from commit 2023-10-03 20:49:57 +07:00
Simon e9eddf06fb
error handling for playlist sub 2023-10-03 19:57:12 +07:00
Simon 8af7a3caf4
better playlist extract error message 2023-10-02 09:09:58 +07:00
Simon 8e79cba7d5
fix continue watching progress matching 2023-10-01 09:34:43 +07:00
Simon 87e457401d
fix duplicated startup migration 2023-10-01 09:34:23 +07:00
Simon bb271e276c
validate backup before creating blank index 2023-10-01 09:17:55 +07:00
Simon 3b7e4c9266
skip id_sb_id migration 2023-10-01 08:36:09 +07:00
Simon 88f5c58b8e
add unstable tag 2023-09-26 09:23:32 +07:00
Igor Rzegocki 6a83756fb4
support for auth forwarding proxy 2023-09-25 22:50:39 +02:00
Simon 515b724047
split json backup files, #406 2023-09-25 15:59:31 +07:00
Simon 77fef5de57
fix standard duration str agg 2023-09-25 14:53:12 +07:00
Simon 9d09d27fba
bump requirements 2023-09-25 14:13:26 +07:00
Simon 0e767e2f84
Merge pull request #551 from ajgon/fix/elasticsearch-ha 
Support elasticsearch clusters
 2023-09-25 12:28:04 +07:00
Simon 7801ed0d60
fix find_results through SearchProcess 2023-09-25 10:14:14 +07:00
Igor Rzegocki 6abec9401b
Mute urlib3 ssl warnings when SSL verification is disabled 2023-09-23 15:00:46 +02:00
Simon 1cdb9e1ad5
refactor find_results use ElasticWrap directly 2023-09-22 23:54:31 +07:00
Simon 7afeb41469
use SearchProcess for single_lookup 2023-09-22 21:51:27 +07:00
Simon bae11fe1f1
fix appconfig init 2023-09-22 21:27:38 +07:00
Simon 0cacaee213
merge testing 2023-09-22 21:22:32 +07:00
Simon 892e81c185
refactor ElasticWrap dynamic kwargs 2023-09-22 20:35:14 +07:00
Igor Rzegocki f423ddc53a
add healthcheck endpoint (#553) 2023-09-22 15:01:47 +07:00
Igor Rzegocki b2bb7ea28e
Support wider spectrum of ElasticSearch configurations 2023-09-22 09:50:47 +02:00
Simon 38b3815a33
catch disabled old settings 2023-09-21 23:17:25 +07:00
Simon 92975a5c95
disable ta_config indexing 2023-09-21 23:16:06 +07:00
Joseph Liu a5b61bfaf6
Add "Mark Unwatched" to channels and playlists (#547) 2023-09-21 22:40:42 +07:00
Clark 85b56300b3
Move user configuration from Redis to ES (#533) 
* ES Client must bootstrap itself to be the source of config

If this is not done a cyclic loop is created between the config loader and the ES client.
This lays the ground work for ES being the source of all app config.

* auto_download is not used anymore

* Add UserConfig class that encapsulates user config storage

This class will allow the rest of the code to 'not care' about how user properties are stored.
This requires the addition of a ta_users index in ES.

* Create migration task for user config transfer

* Replace getters and setters for each property

Strongly type the user configuration
Migrate missed sponsorblock ID

* Other DB settings will be another PR
 2023-09-21 21:46:55 +07:00
Simon a7fc7902f0
refactor single video page to use SearchProcess 2023-09-04 21:43:09 +07:00
Simon 879f5ab52f
refactor match_progress to use SearchProcess 2023-09-04 21:05:29 +07:00
Simon c6458c6ec1
add score to full text search 2023-09-04 20:44:31 +07:00
Simon 47c433e7c1
refactor search form to use new SearchProcess 2023-09-04 20:22:00 +07:00
Simon dc41e5062d
refactor duration class into separate helper functions 2023-09-04 18:49:10 +07:00
Merlin 317942b7e1
Refac biggest channels to be 3 seperate tables with ordering and right align (#536) 
* Add right align to numbers on biggest channels in dashboard

* Refac biggest channels to be 3 seperate tables with ordering

* Fix aggs linting
 2023-09-04 17:51:06 +07:00
Merlin 65d768bf02
Fix url to settings documentation (#535) 2023-09-04 17:24:48 +07:00
Simon a807d53ff8
update TA_VERSION 2023-09-03 12:05:51 +07:00
Simon fa45cf08ba
fix mobile table layout 2023-09-02 17:37:28 +07:00
Simon 5cf5b4edb7
clean log 2023-09-02 16:42:41 +07:00
Simon 0c9c88fc0b
buildStats async 2023-09-02 16:31:43 +07:00
Simon 725bba0963
add randint sleep before version check 2023-09-02 16:02:04 +07:00
Simon 76981635dc
reset autostart on queue stop, #520 2023-09-02 12:06:43 +07:00
Simon 8dba2e240e
handle empty download hist stat 2023-09-02 11:47:07 +07:00
Simon 4016e81f9a
add download history stats 2023-09-02 11:22:03 +07:00
Simon 5ee37eb0cb
add biggest chanel aggs 2023-09-01 09:28:56 +07:00
Simon 4650963cc7
add watch progress tiles 2023-08-31 22:28:36 +07:00
Simon 5acc1ea718
add all duration aggs 2023-08-31 21:31:47 +07:00
Simon 505f5b73c5
add primary aggs 2023-08-31 14:34:08 +07:00
Simon d491b0b347
[API] better primary stats 2023-08-31 12:51:00 +07:00
Simon 52d6c59f3f
fix incomplete messages outside of sendprogress task method 2023-08-31 12:16:42 +07:00
Simon 4afb605736
show all messages on settings pages 2023-08-31 12:16:17 +07:00
Clark fcc1c2a648
Split the settings page (#528) 
* Split the settings page

* Add a dashboard page for future use

Create a settings base to keep all the settings pages consistent

* Correct Python formatting

* Fix snapshots not showing in new view
 2023-08-31 11:11:31 +07:00
Simon 4ded8988c3
add channel aggregation 2023-08-30 18:42:03 +07:00
Simon 988c2b8af7
add download video histogram stats 2023-08-30 17:42:10 +07:00
Simon 58ef8f753f
fix date epoch sec format 2023-08-30 11:54:02 +07:00
Simon 3e9f1a392a
[API] add index count and video view progress stats views 2023-08-29 15:45:55 +07:00
Simon fb089dd3de
add unstable footer 2023-08-26 21:17:32 +07:00
dmynerd78 983612f460
Add fullscreen hotkey to video player (#524) 
* Add fullscreen hotkey

* Run prettier formatting
 2023-08-26 21:15:36 +07:00
Simon d42bd612d0
handle 404 video sponsorblock, #526 2023-08-26 21:05:17 +07:00
Simon 41f6a03751
fix typing 2023-08-25 15:00:03 +07:00
Simon f1e25c9a20
[API] add channel search endpoint 2023-08-24 22:46:35 +07:00
Simon 68928f5cb1
ignore eaDir folder, use ignore_filelist for clear_dl_cache, #523 2023-08-24 00:02:58 +07:00
Simon a514dda1ff
[API] implement delete playlist endpoint 2023-08-23 23:54:36 +07:00
Simon 2bccb698e6
remove legacy process subscribe methods 2023-08-23 23:34:19 +07:00
Simon 076452c612
move subscribe buttons to API calls 2023-08-23 23:28:09 +07:00
Simon b005b7bcfe
[API] validate sub type, add sub/unsub channel and playlist 2023-08-23 22:28:09 +07:00
Simon a2eb42ebb9
validate subscribe url type, #299 2023-08-23 21:22:09 +07:00
Simon 33ff586af4
bump requirements 2023-08-23 21:18:20 +07:00
Simon 3803537739
trigger bgsave on importent redis set_message 2023-08-23 18:35:20 +07:00
Simon 58818bb91c
better thumbnail final fall back handling 2023-08-22 18:12:21 +07:00
Simon 8411889db7
add type hints to filesystem scanner 2023-08-09 09:45:51 +07:00
Simon 313bbe8b49
fix wrong resolve doc string 2023-08-06 10:26:47 +07:00
Simon 2238565a94
bump TA_VERSION 2023-08-05 11:44:52 +07:00
Simon fa43753614
better error handling in comment extraction 2023-08-05 09:53:21 +07:00
Simon 02be39b6ed
hide/reveal apprise links 2023-08-01 00:30:11 +07:00
Simon 375e1a2100
set initial comment toggle icon 2023-07-31 23:57:03 +07:00
Simon c1ea77434e Merge branch 'master' into testing 2023-07-31 23:52:13 +07:00
crocs 0e1e544fee
update imagery (#507) 
* Update script.js

* Update README.md

updated banner photo

* Add files via upload

* Delete tube-archivist-banner.jpg

* Delete tube-archivist-banner.jpg.jpg

* Add files via upload

* Delete tube-archivist-banner.jpg

* Add files via upload

* Delete tube-archivist-banner.jpg

* Add files via upload

* Update README.md

* Delete tube-archivist-screenshot-channels.png

* Delete tube-archivist-screenshot-download.png

* Delete tube-archivist-screenshot-home.png

* Delete tube-archivist-screenshot-single-channel.png

* Delete tube-archivist-screenshot-video.png

* Add files via upload

* Update SHOWCASE.MD

* Delete tube-archivist-screenshot-channels.png

* Delete tube-archivist-screenshot-download.png

* Delete tube-archivist-screenshot-single-channel.png

* Delete tube-archivist-screenshot-video.png

* Add files via upload

* Update SHOWCASE.MD

* Add files via upload

* Update SHOWCASE.MD

* Add files via upload

* Delete tube-archivist-search.png

* Add files via upload

* Update SHOWCASE.MD

* Update SHOWCASE.MD
 2023-07-31 23:48:46 +07:00
Simon a13cd2f7ba
catch timeout in es connection check, part 2 2023-07-31 19:59:16 +07:00
Simon befdc64772
catch timeout in es connection check 2023-07-31 09:08:54 +07:00
Simon c395a949cc
add localhost and tubearchivist to default trusted 2023-07-30 00:13:15 +07:00
Simon 4473e9c5b2
add apprise notifications 2023-07-29 23:41:54 +07:00
Simon 75a63c4828
paginate channel migration index update 2023-07-29 17:05:01 +07:00
Simon aea403a874
additional thumb dl error handling 2023-07-28 18:19:22 +07:00
Simon ab8fed14bb
handle edge cases in migration clean up 2023-07-28 17:56:28 +07:00
Simon 6f915a5733
fix channel tv art extraction 2023-07-28 16:34:39 +07:00
Simon f970ec867e
clarify subtitle language codes on settings page, #505 2023-07-28 16:10:52 +07:00
Simon ef0d490890
[API] change dates to ISO format 2023-07-28 15:56:59 +07:00
lamusmaser 865089d46d
Resolve #502 by making the extension lowercase before comparison. (#504) 
* Resolve #502 with making the extension lowercase.
Add note to `EXT_MAP` reference.

* Fixed comment for linting, added more details.
 2023-07-27 21:01:53 +07:00
Simon d500fa5eeb
add unstable footer 2023-07-25 00:07:11 +07:00
Simon 4c681d813d
fix lint 2023-07-25 00:05:43 +07:00
Simon 434aa97a86
static cache file path building, #498 2023-07-24 23:44:27 +07:00
Simon efde4b1142
skip subtitle if not processed yet, #496 2023-07-24 12:11:21 +07:00
Simon 6022bdd3cd
fix doc string 2023-07-24 11:27:19 +07:00
Simon 99baf64b11
update requirements 2023-07-24 10:51:37 +07:00
Simon 61b04ba5cf
channel migration take 2 2023-07-24 10:51:13 +07:00
Simon 2a60360f4a
handle empty channel migration cleanup 2023-06-28 20:07:40 +07:00
Simon 8a7cb8bc6f
bump redis 2023-06-28 20:07:17 +07:00
lamusmaser 1be80b24c2
Implement #490 - Add version API and add local_version function. (#491) 
* Add version API and add local_version function.

* Minor adjustments for linting.

* Add missing newlines for linter.

* Add missing comma to `urls.py`.

* Remove `version/` endpoint.

* Remove the `VersionView`.

* Prepare `PingView` for removal of the `is_static` response.

* Remove the `is_unstable` response from `ReleaseVersion`.

* Readd missing class instantiation for first call of `ReleaseVersion`.
 2023-06-28 10:50:28 +07:00
Simon 061c653bce
retry get config better startup error handling, #485 2023-06-23 00:15:07 +07:00
Simon 72a98b0473
handle missing channel_tvart_url in thumb validator, #479 2023-06-22 23:36:54 +07:00
Simon 88e199ef9c
reset reindex counter on new added to queue, #478 2023-06-22 23:29:05 +07:00
Simon 879497d25a
bump libs 2023-06-22 23:28:17 +07:00
Simon 103409770d
temporary fix for is_favorited extraction error 2023-06-22 23:27:16 +07:00
Simon 094ccf4186
bump libs 2023-06-16 15:48:02 +07:00
Simon 247808563a
download error recovering 2023-06-16 15:47:38 +07:00
simon 5927ced485
bump libs 2023-05-27 18:26:34 +07:00
simon 6fb788b259
add delete button for unavailable video 2023-05-22 17:34:49 +07:00
simon 5e92d06f21
fix dl error retry logic, store and return error, #477 2023-05-20 21:25:50 +07:00
simon 7082718c14
add days to seconds string converter 2023-05-20 20:08:36 +07:00
simon 7e2cd6acd3
fix linter, take 2 2023-05-20 19:41:33 +07:00
simon 904d0de6aa
fix linter 2023-05-20 19:37:41 +07:00
simon c4e2332b83
fix startup race condition cluster health 2023-05-20 19:29:32 +07:00
simon 139d20560f
remove unused channel folder refresh 2023-05-20 16:30:19 +07:00
simon 66a14cf389
remove unused clean_string 2023-05-20 16:08:43 +07:00
simon 9b30c7df6e
refacter filesystem scanner 2023-05-20 16:07:33 +07:00
simon 5334d79d0d
default query 2023-05-20 15:38:55 +07:00
simon 64984bc1b3
fix chown for mig new folder 2023-05-19 14:49:49 +07:00
simon 8ef59f5bff
delete channel path building 2023-05-18 20:32:58 +07:00
simon 9d6ab6b7b3
implement new media_url 2023-05-18 20:32:37 +07:00
simon d62b0d3f8d
implement simplified path migration 2023-05-18 17:42:15 +07:00
simon 918a04c502
allow empty data for paginate 2023-05-18 17:01:07 +07:00
simon 60f1809ed8
fix rescan without task 2023-05-17 23:24:47 +07:00
simon f848e73251
HOTFIX: default bitrate, #415 2023-05-14 08:01:15 +07:00
simon c65fbb0b60
add filesystem rescan message 2023-05-14 07:58:10 +07:00
simon 95f114d817
remove leftover print statement 2023-05-14 07:52:51 +07:00
simon 05eac1a8ca
hotfix: skip filesystem rescan 2023-05-13 23:24:35 +07:00
simon ea42f0f1e3
bump TA_VERSION v0.3.6 2023-05-13 20:48:01 +07:00
simon a9b5713629
add channel tags to searching 2023-05-07 20:46:46 +07:00
simon dbaa13bfb0
apply auto_start sort to dl queue 2023-05-07 19:41:37 +07:00
simon 5d0d050149
fix channel reindex flow 2023-05-07 17:45:48 +07:00
simon c327e94726
add filesystem rescan to video migration 2023-05-07 15:40:01 +07:00
simon 774780d520
fix filesystem rescan without task 2023-05-07 15:36:26 +07:00
simon 5e1167743f
fix migration notification logic 2023-05-07 12:06:55 +07:00
simon 4376b826c4
add auto tag to video in queue 2023-05-07 12:06:38 +07:00
simon 206921baf0
add unstable footer 2023-05-07 09:58:07 +07:00
simon 0d2d3353a9
add extractor lang, #316 2023-05-07 09:47:03 +07:00
simon b47687535a
undo faulty channel sync to videos 2023-05-05 19:21:09 +07:00
simon e092a29b13
bump libs 2023-05-05 19:20:51 +07:00
simon 170839362e
fix ignoring progress message when not initiated with task 2023-05-04 11:48:38 +07:00
simon b95a659396
fix empty channel_subs parsing 2023-05-02 12:42:35 +07:00
simon 2b66786728
switch channel index to yt-dlp, index tags 2023-05-02 11:45:34 +07:00
simon b7bfeaf215
add channel tags to mapping 2023-05-02 11:44:51 +07:00
simon 5cc642098d
remove old migration 2023-04-29 18:42:29 +07:00
simon 7c01ad88b2
fix startup MediaStreamExtractor error handling 2023-04-29 18:37:54 +07:00
simon e866bb3be5
bump libs 2023-04-29 17:08:13 +07:00
simon 63021bd313
add autostart subs to config form 2023-04-29 16:54:54 +07:00
simon cbcb7484a7 Merge branch 'feature/queue-autorun' into testing 2023-04-29 16:41:19 +07:00
Dominik Sander 1c0b407f3f
Allow to configure yt-dlp `--format-sort` argument (#471) 
* Allow to configure yt-dlp `--format-sort` argument

This exposes the [`--format-sort`][1] yt-dlp option to the user.

Implements parts of #316

[1]: https://github.com/yt-dlp/yt-dlp#sorting-formats

* Trim split values of format_sort, obey black

* Add `format_sort` to default configuration

* Add note about codec compatibility to settings page
 2023-04-29 16:32:52 +07:00
simon 280c773441
add download now to form 2023-04-29 14:17:36 +07:00