simon
1fa26cdc44
added basic cookie import functionality
2022-04-23 21:59:59 +07:00
simon
04fc6ed26a
API: add pagination
2022-04-20 22:43:07 +07:00
simon
3147df20da
skip subtitle segments without duration, take 2
2022-04-18 11:52:13 +07:00
simon
50f4e0e5b7
skip base64 generator, hotfix
2022-04-16 13:08:32 +07:00
simon
59f1c111aa
extend timeout for sleep interval
2022-04-16 08:58:35 +07:00
simon
fe610fdaca
add log output for backup progress
2022-04-15 20:41:38 +07:00
simon
c84fbdfb9c
fix _check_get_sb for per channel deactivate
2022-04-15 20:04:01 +07:00
simon
7231b5d245
implement unset of sb per channel overwrite
2022-04-15 20:03:15 +07:00
dc29c6718c
Fix : #210 - Download UI Box being removed when file is still processing ( #219 )
...
* Fix: https://github.com/bbilly1/tubearchivist/issues/210 - Download UI element is removed when the file has finished downloading, but is still being moved on disk to the storage destination. This means the user is presented with nothing in the UI yet the file is still being processed.
* FIX: Resolving linting issue
* FIX: Set moving message to never expire and then a second message after the move with a 4 second expiry timer.
Co-authored-by: Rob Ainsworth <roba@immjsystems.com>
2022-04-15 15:21:24 +07:00
simon
d4b1d97f5c
add mappings for sponsorblock segments
2022-04-15 15:16:31 +07:00
simon
f71644c8bc
guarantee stats in mapping for sort
2022-04-15 15:03:43 +07:00
simon
4853a8b12b
limit video_daily to below 10k in daily refresh
2022-04-14 16:18:08 +07:00
simon
fd00369859
fix last page pagination link building error, #221
2022-04-14 16:04:21 +07:00
simon
a8a7edb93e
skip subtilte events without duration, #196
2022-04-14 15:53:10 +07:00
simon
3007e02fe5
fix per channel sb integration
2022-04-13 15:53:00 +07:00
simon
8edde732b6
improved sponsorblock key with additional metadata
2022-04-12 17:47:13 +07:00
simon
3df1df8b5a
set explicit mappings for sponsorblock key
2022-04-12 17:45:06 +07:00
simon
31378ac756
better generic schedule validator for impossible input, #209
2022-04-10 15:58:11 +07:00
simon
9d73dbc45a
implement video overwrites index for sponsorblock
2022-04-08 17:19:25 +07:00
simon
365ebf53a5
implement per channel sponsorblock
2022-04-08 17:17:39 +07:00
simon
fe3e3cfacc
fix filenotfounderror for missing subtitles when deleting video
2022-04-08 15:56:34 +07:00
simon
a07d789e66
add base64 blur video thumb
2022-04-08 00:29:09 +07:00
simon
6a1cb15114
validate hours to not be greater than 23, #209
2022-04-07 23:02:07 +07:00
simon
b1a7a6a148
use cleaned_data for config form parser
2022-04-07 22:30:20 +07:00
simon
03dd25cff4
implement vote on sponsorblock segments api
2022-04-05 22:25:40 +07:00
simon
bace7d41af
add random string generator helper function
2022-04-05 21:51:10 +07:00
simon
738b083a7f
create dedicated SponsorBlock class to handle integration
2022-04-05 21:50:40 +07:00
simon
a8b62e5cdc
better error message on sponsorblock fail
2022-04-04 23:28:32 +07:00
simon
730d12212f
implement basic sponsblock indexing, #119
2022-04-04 23:28:32 +07:00
simon
cdc617c382
add datestr generator
2022-03-29 16:47:21 +07:00
simon
f15bb50cfe
fix playlist reindex after PendingList refactor
2022-03-26 18:31:00 +07:00
simon
fcadb5ead8
add random headers for requests outside of yt-dlp
2022-03-26 11:49:53 +07:00
simon
a0ed88580f
fix index validate_mappings for new nested object
2022-03-26 10:52:57 +07:00
simon
8d1d09e698
extend IndexPaginate to optionally return _source key
2022-03-23 17:17:42 +07:00
simon
fb4c11bd38
refactor ElasticIndex and ElasticBackup to use ElasticWrap and IndexPaginate
2022-03-23 17:17:17 +07:00
simon
bfcc538ed1
fix concurrency issue with subtitle indexing
2022-03-23 16:20:33 +07:00
simon
912c19f6cf
use ElasticWrap in FilesystemScanner
2022-03-23 15:56:53 +07:00
simon
fda520ad44
refactor and consolidate Reindex class
2022-03-23 15:48:38 +07:00
simon
1f7d6871cf
use ElasticWrap to delete item from pending
2022-03-23 11:09:21 +07:00
simon
5b1c9c64de
cleanup, use ElasticWrap
2022-03-23 09:44:31 +07:00
simon
9f5c9b17a5
refactor redis connection, fix sync_redis_state task setup issue
2022-03-22 17:50:54 +07:00
simon
75cd9d382d
fix duration builder on reindex by ignoring vtt files
2022-03-22 12:59:39 +07:00
simon
1f1dfcb54f
better playlist scan message, private methods in YoutubeChannel class
2022-03-22 10:07:33 +07:00
simon
3d451e47e5
full playlist refresh and index for channel overwrites
2022-03-22 09:42:41 +07:00
simon
91a9477bba
refactor index_channel_playlists task, move to YoutubeChannel class
2022-03-21 17:59:21 +07:00
simon
fc311a7b7e
refactor validate_playlists and move into DownloadPostProcess class
2022-03-21 11:14:44 +07:00
simon
f803c5298b
fix missing update_status method call in ignore video
2022-03-21 11:09:16 +07:00
simon
7c6041d686
refactor VideoDownloader and implement per channel delete older than
2022-03-19 17:37:28 +07:00
simon
1411262793
remember channel overwrites on rescan, remove unused rescape_all_channels method
2022-03-19 15:12:29 +07:00
simon
9fd7e2b11a
rename channel_overwrites attribute
2022-03-19 15:03:38 +07:00
simon
3ba6e0478d
fix filesysem rescan function
2022-03-19 14:36:46 +07:00
simon
b68a00073f
fix thumbnail validation with new PendingList class
2022-03-19 14:27:37 +07:00
simon
89428297c9
add download format channel overwrite per video
2022-03-18 22:22:41 +07:00
simon
ac9df4e082
map channel overwrite to video id for later efficient mapping
2022-03-18 21:39:33 +07:00
simon
a6937db5fd
use the refactored PendingList class
2022-03-18 18:27:25 +07:00
simon
05b8dbc02f
refacor PendingList class into subclasses
2022-03-18 17:19:21 +07:00
simon
1498fadf27
implement channel playlist index overwrite
2022-03-16 12:32:42 +07:00
simon
f0e82caebb
add bool true to channel overwrite form parser
2022-03-16 12:32:02 +07:00
simon
2ef8823c2d
better channel overwrite update form
2022-03-16 12:09:50 +07:00
simon
544d842a4a
rename channel format overwrite field
2022-03-15 17:45:15 +07:00
simon
774220ab1f
add channel overwrite form to frontend, store in es
2022-03-15 12:00:48 +07:00
simon
026cc378fe
add get_overwrites and set_overwrites methods for channel
2022-03-12 22:19:42 +07:00
simon
aff0cfb794
fix retiming issue for auto subtitles
2022-03-11 17:47:04 +07:00
simon
d3e9646fb6
private methods for YoutubeSubtitle and SubtitleParser
2022-03-10 20:45:13 +07:00
simon
1ce832b846
fix autocaption extraction, flatten words, #180
2022-03-10 19:58:13 +07:00
simon
c186798e78
rewrite SubtitleParser, #180
2022-03-09 00:25:44 +07:00
simon
b98ccd9dab
handle error if subscribed channel not available anymore, #175
2022-02-25 11:21:29 +07:00
simon
c4d6bb35a3
add list_items for wildcard matching
2022-02-24 18:55:18 +07:00
simon
ec00568008
fix auto reset of playlist_subscribed
2022-02-20 19:22:11 +07:00
simon
8fce31b983
fix reindex and deactivate error
2022-02-13 10:05:08 +07:00
simon
78720b33b7
clean exit when auto subtitle extract fails
2022-02-12 18:52:03 +07:00
simon
ce4fa8ee61
delete existing before of reindexing subtitles
2022-02-12 18:22:01 +07:00
simon
a5f6be16e1
switch subtitle source order
2022-02-12 17:09:05 +07:00
simon
b494fc10af
cover edge cases where end timestamp is after start timestamp of new cue
2022-02-12 16:03:04 +07:00
simon
09500557c8
open fail on subtitle line parse error
2022-02-11 18:47:29 +07:00
simon
08f5248e7a
make subtitle index optional
2022-02-11 13:36:36 +07:00
simon
af8e01cd8c
fix clean exit if no subtitles selected
2022-02-11 09:03:56 +07:00
simon
4d30bed3cc
extend delete video to also delete subtitles
2022-02-10 19:09:07 +07:00
simon
0e56efc428
limit filesystem scan to mp4 files only
2022-02-10 18:48:35 +07:00
simon
077692987b
fix multi language subtitle extractor, and better regex for timestamp matching
2022-02-10 18:32:23 +07:00
simon
b071612038
better error raising for add player info
2022-02-10 17:34:21 +07:00
simon
0414df0de0
fix key error for subtitle source
2022-02-10 17:10:30 +07:00
simon
a2cae51f48
bulk import subtitle lines into es
2022-02-10 17:02:19 +07:00
simon
9f652802ae
add new mapping for subtitle index
2022-02-10 11:47:14 +07:00
simon
4e4cfe3334
pass whole video object into YoutubeSubtitle class
2022-02-09 23:40:15 +07:00
simon
6cb892a811
integrate auto generated subtitle cleaner
2022-02-09 21:33:41 +07:00
simon
5f6158243e
auto generated subtitle parser and cleaner
2022-02-07 21:18:52 +07:00
simon
e98ffc0050
add subtitles mapping to video index
2022-02-05 23:50:47 +07:00
simon
52013aff3f
fix subtitle download of first video of channel without folder
2022-02-05 23:42:42 +07:00
simon
44af78b7e3
handle NA in ffprobe duration extractor
2022-02-05 23:09:05 +07:00
simon
2bf9e9683b
error handeling in _normalize_lang to skip livechat and ignore missing
2022-02-05 22:51:38 +07:00
simon
f5f46349b2
handle rescan name change
2022-02-05 22:38:59 +07:00
simon
ac531affb5
standardize country specific subtitle language codes
2022-02-05 16:07:11 +07:00
simon
3ef35a9d53
raise FileNotFoundError to catch for reindex
2022-02-05 09:30:34 +07:00
simon
7aaf140ccb
index subtitle url to video
2022-02-04 17:14:00 +07:00
simon
a82e78f8bf
index selected subtitles if available
2022-01-30 23:57:58 +07:00
simon
365a2bf59f
add frontend subtitle dl settings
2022-01-30 20:10:29 +07:00
simon
e5e83287ab
fix channel delete for channel_id fallback folders
2022-01-30 08:33:10 +07:00
simon
8e860d4f01
fix last page error for more than 10k results, #156
2022-01-27 23:39:07 +07:00
simon
0749202d5d
add fallback for none ascii channel names, #127 #146
2022-01-27 22:50:02 +07:00
simon
Ainsey11